Shahar Mike
47a1305ea1
Fix BullMQ tests workflow in GitHub actions ( #4565 )
...
Squash
Co-authored-by: shahar <shahar@dragonflydb.io>
2025-02-05 13:56:52 +00:00
Roman Gershman
6d1c22b64c
chore: GlobMatcher uses now reflex::Matcher regex engine ( #4528 )
...
Also consolidate benchmarking low level routines undeer dfly_core_test
```
BM_ParseFastFloat 707 ns 707 ns 4005656
BM_ParseDoubleAbsl 1460 ns 1460 ns 1927158
BM_MatchGlob/1000 121 ns 121 ns 23701780
BM_MatchGlob/10000 512 ns 512 ns 5481405
BM_MatchFindSubstr/1000 123 ns 123 ns 31114255
BM_MatchFindSubstr/10000 1126 ns 1126 ns 2522019
BM_MatchReflexFind/1000 118 ns 118 ns 22442417
BM_MatchReflexFind/10000 512 ns 512 ns 5414329
BM_MatchReflexFindStar/1000 106 ns 106 ns 26276727
BM_MatchReflexFindStar/10000 717 ns 717 ns 3719605
BM_MatchStd/1000 19782 ns 19779 ns 128020
BM_MatchStd/10000 199809 ns 199781 ns 13837
BM_MatchRedisGlob/1000 1601 ns 1601 ns 1754635
BM_MatchRedisGlob/10000 16494 ns 16493 ns 171585
BM_MatchRe2/1000 1039 ns 1039 ns 2709486
BM_MatchRe2/10000 10041 ns 10040 ns 281296
```
What's curious is that now matching `*foobar*` on string is faster than
searching for 'foobar` using string::find() (BM_MatchGlob vs BM_MatchFindSubstr)
Improvement vs Redis is 10-30 times faster (BM_MatchRedisGlob vs BM_MatchGlob).
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2025-02-05 10:29:51 +02:00
Kostas Kyrimis
abe3306abd
chore: remove clang install step from ci workflow ( #4550 )
...
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-02-04 15:00:07 +02:00
Borys
c95ad19830
chore: update release build for arm ( #4519 )
...
fix: release build for arm
2025-01-30 12:56:47 +00:00
Kostas Kyrimis
c05d1cafc8
chore(ci): report proactor kind on reg test failure ( #4531 )
...
* include epoll or iouring on notification failures
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-01-30 14:24:32 +02:00
Roman Gershman
fc94b2c265
chore: add more logs to the op_manager code ( #4527 )
...
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2025-01-29 19:08:41 +02:00
dependabot[bot]
d945b831db
chore(deps): bump github/codeql-action from 3.28.0 to 3.28.5 in the actions group across 1 directory ( #4514 )
...
chore(deps): bump github/codeql-action
Bumps the actions group with 1 update in the / directory: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.28.0 to 3.28.5
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](48ab28a6f5...f6091c0113
2025-01-28 08:57:24 +02:00
Kostas Kyrimis
e5da019419
chore: split epoll/uring reg test flows ( #4512 )
...
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-01-27 11:14:07 +02:00
Roman Gershman
904775cfe6
chore: new docker build pipeline ( #4503 )
...
Our previous weekly pipeline used qemu, was very slow and over-complicated.
This one uses matrix with proper parallelization and the latest arm64 github runners.
now it takes less than 30 minutes to build everything.
lets make it daily.
2025-01-26 12:03:42 +02:00
Kostas Kyrimis
4a2f2e3d04
chore: add sanitizers to ci workflow ( #4462 )
...
* chore: add sanitizers to ci workflow
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-01-22 12:00:10 +02:00
Kostas Kyrimis
85cc443448
chore: run regression tests with epoll ( #4426 )
...
* chore: run regression tests with epoll
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-01-20 14:18:21 +02:00
Shahar Mike
6f3c6e3d57
chore: Fix all clang build warnings ( #4475 )
...
* chore: Fix all clang build warnings
Also add `-Werror` to clang build in CI.
Fixes #4449
* all build targets
* fix search test
2025-01-20 10:24:07 +02:00
Kostas Kyrimis
c759eb8ce6
chore: replace deprecated HELIO_STACK_CHECK ( #4465 )
...
* remove HELIO_STACK_CHECK
* use FLAGS_fiber_safety_margin
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-01-20 10:17:24 +02:00
Daniel M
6f0072e462
Fix test hypothesis ( #4380 )
...
* fix:test-hypothesis
---------
Co-authored-by: Roman Gershman <roman@dragonflydb.io>
2025-01-17 07:59:44 +02:00
Kostas Kyrimis
0eff6c93f2
fix(ci): sanitizers build ( #4457 )
...
* compile with clang
* update container to version 24
* move to x86 github runner ubuntu 24
* use compiler-rt instead of libgcc
* add cmake glue
2025-01-15 12:39:43 +02:00
Roman Gershman
ff4add0c9e
chore: deprecate unneeded runtime flags ( #4405 )
...
Deprecate multi_exec_mode and track_exec_frequencies.
Remove duplicated call to EnterLameDuck (done also in Service::Shutdown()).
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2025-01-05 13:31:59 +00:00
adiholden
0f5eb33e6a
chore(pytest): add timeout per test ( #4404 )
...
regression action add 5 minutes timeout per test
Signed-off-by: adi_holden <adi@dragonflydb.io>
2025-01-05 13:19:13 +02:00
dependabot[bot]
c88c707341
chore(deps): bump the actions group across 1 directory with 2 updates ( #4361 )
...
Bumps the actions group with 2 updates in the / directory: [mozilla-actions/sccache-action](https://github.com/mozilla-actions/sccache-action ) and [github/codeql-action](https://github.com/github/codeql-action ).
Updates `mozilla-actions/sccache-action` from 0.0.6 to 0.0.7
- [Release notes](https://github.com/mozilla-actions/sccache-action/releases )
- [Commits](https://github.com/mozilla-actions/sccache-action/compare/v0.0.6...v0.0.7 )
Updates `github/codeql-action` from 3.27.5 to 3.28.0
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](f09c1c0a94...48ab28a6f5
2024-12-25 05:30:59 +02:00
Roman Gershman
95cd9dfb4c
chore: update helio and improve our stack overflow resiliency ( #4349 )
...
1. Run CI/Regression tests with HELIO_STACK_CHECK=4096.
This will crash if a fiber stack usage goes below this limit.
2. Increase shard queue stack size to 64KB
3. Increase fiber stack size to 40KB on Debug builds.
4. Updated helio has some changes around the TLS socket code.
In addition we add a helper script to generate self-signed certificates helpful for local development work.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-12-23 08:13:45 +00:00
Roman Gershman
a87d6aecef
chore: fully support qlist in all list_family commands ( #4201 )
...
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-27 13:56:56 +02:00
dependabot[bot]
5c84f21caf
chore(deps): bump github/codeql-action from 3.27.4 to 3.27.5 in the actions group ( #4186 )
...
chore(deps): bump github/codeql-action in the actions group
Bumps the actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.27.4 to 3.27.5
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](ea9e4e3799...f09c1c0a94
2024-11-26 10:04:40 +02:00
Roman Gershman
2c663f3833
chore: produce core files in regtests ( #4185 )
...
Should work only for self-hosted runners.
The core files will be kept in /var/crash/
We also copy automatically dragonfly binary into /var/crash to be able to debug later.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-25 17:13:11 +00:00
Tarun Pothulapati
3d68c9c99e
fix(release/helm): allow empty commits for rerun ( #4163 )
...
* fix(release/helm): allow empty commits for rerun
* remove empty commit and just move forward
2024-11-25 08:29:10 +00:00
dependabot[bot]
907346e3e6
chore(deps): bump github/codeql-action from 3.27.1 to 3.27.4 in the actions group ( #4148 )
...
chore(deps): bump github/codeql-action in the actions group
Bumps the actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.27.1 to 3.27.4
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](4f3212b617...ea9e4e3799
2024-11-18 23:05:42 +02:00
Daniel M
d241839cff
chore:update fakeredis, remove irrelevant tests ( #4014 )
...
* chore:update fakeredis, remove irrelevant tests
2024-11-17 20:24:46 +02:00
dependabot[bot]
a887d822a9
chore(deps): bump github/codeql-action from 3.27.0 to 3.27.1 in the actions group ( #4115 )
...
chore(deps): bump github/codeql-action in the actions group
Bumps the actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.27.0 to 3.27.1
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](662472033e...4f3212b617
2024-11-14 19:28:25 +02:00
Blanky
43060ba79e
chore(dependabot): Allows only security patches ( #4075 )
...
* feat(dependabot): Add dependabot to check for vulnerabilies and update dependencies
---------
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
Signed-off-by: Blanky <131886247+BLANKatGITHUB@users.noreply.github.com>
2024-11-08 08:08:33 +02:00
dependabot[bot]
aa4a61894d
chore(deps): bump docker/build-push-action from 5 to 6 ( #4055 )
...
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 5 to 6.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](https://github.com/docker/build-push-action/compare/v5...v6 )
---
updated-dependencies:
- dependency-name: docker/build-push-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:38:06 +02:00
dependabot[bot]
d6ec5910d1
chore(deps): bump github/codeql-action from 3.24.9 to 3.27.0 ( #4054 )
...
Bumps [github/codeql-action](https://github.com/github/codeql-action ) from 3.24.9 to 3.27.0.
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](1b1aada464...662472033e
2024-11-04 22:37:51 +02:00
dependabot[bot]
8dc12a39e5
chore(deps): bump ossf/scorecard-action from 2.3.1 to 2.4.0 ( #4053 )
...
Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action ) from 2.3.1 to 2.4.0.
- [Release notes](https://github.com/ossf/scorecard-action/releases )
- [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md )
- [Commits](0864cf1902...62b2cac7ed
2024-11-04 22:37:07 +02:00
dependabot[bot]
f67103f9b0
chore(deps): bump mozilla-actions/sccache-action from 0.0.4 to 0.0.6 ( #4051 )
...
Bumps [mozilla-actions/sccache-action](https://github.com/mozilla-actions/sccache-action ) from 0.0.4 to 0.0.6.
- [Release notes](https://github.com/mozilla-actions/sccache-action/releases )
- [Commits](https://github.com/mozilla-actions/sccache-action/compare/v0.0.4...v0.0.6 )
---
updated-dependencies:
- dependency-name: mozilla-actions/sccache-action
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:36:20 +02:00
dependabot[bot]
18f7d9bbd5
chore(deps): bump mikepenz/action-junit-report from 4 to 5 ( #4052 )
...
Bumps [mikepenz/action-junit-report](https://github.com/mikepenz/action-junit-report ) from 4 to 5.
- [Release notes](https://github.com/mikepenz/action-junit-report/releases )
- [Commits](https://github.com/mikepenz/action-junit-report/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: mikepenz/action-junit-report
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:35:47 +02:00
BLANKatGITHUB
fb7ea6c827
feat(dependabot): Add dependabot to check for vulnerabilies and updat… ( #4035 )
...
* feat(dependabot): Add dependabot to check for vulnerabilies and update dependencies
* feat(dependabot): Adds dependabot to update dependencies automatically
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
* feat(dependabot): adds support for dependabot
---------
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
2024-11-04 19:19:04 +02:00
BLANKatGITHUB
851e43211e
refactor(workflow): changes default permissions to read for few workflows increasing security ( #3905 )
...
* refactor: makes read default permision
---------
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
2024-10-26 19:58:23 +03:00
Ishmael Rufus
7b5fc9a244
fix(build): Reduced checks permission in build to read #3821 ( #3916 )
...
Reduced permission to read
2024-10-24 21:35:49 +03:00
Stepan Bagritsevich
ea9dc9c454
chore(fakeredis): Enable JSON tests in the Fakeredis tests ( #3773 )
...
* chore(fakeredis): Enable JSON tests in the Fakeredis tests
fixes dragonflydb#3671
Signed-off-by: Stsiapan Bahrytsevich <stefan@dragonflydb.io>
* refactor: address comments
Signed-off-by: Stsiapan Bahrytsevich <stefan@dragonflydb.io>
* tmp commit
Signed-off-by: Stsiapan Bahrytsevich <stefan@dragonflydb.io>
* refactor: address comments 2
Signed-off-by: Stsiapan Bahrytsevich <stefan@dragonflydb.io>
---------
Signed-off-by: Stsiapan Bahrytsevich <stefan@dragonflydb.io>
2024-10-23 08:53:14 +02:00
Kostas Kyrimis
d2a83121e4
fix: pre-commit ci workflow ( #3917 )
...
* fix: pre-commit ci workflow
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-10-15 12:15:57 +03:00
Daniel M
1958e09a9a
refactor: refactor fakeredis tests ( #3852 )
...
* refactor:fakeredis tests
2024-10-03 12:41:05 +03:00
Andy Dunstall
a64fc74ce1
tests: fix and enable s3 snapshot test ( #3720 )
...
* test: fix s3 snapshot test
* ci: configure s3 regression test
* tests: only run s3 snapshot test if bucket not empty
2024-09-17 17:35:53 +03:00
Roman Gershman
e21ba0b3d9
chore: symbolize stack traces in tests upon crash ( #3714 )
...
We disable address space randomization when building the binary
and use addr2line to symbolize the stacktrace if it exists.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-09-16 13:43:16 +03:00
Roman Gershman
b7b96424e4
deprecate RecordsPopper and serialize channel records during push ( #3667 )
...
chore: deprecate RecordsPopper and serialize channel records during push
Records channel is redundant for DFS/replication because we have single producer/consumer
scenario and both running on the same thread. Unfortunately we need it for RDB snapshotting.
For non-rdb cases we could just pass a io sink to the snapshot producer,
so that it would use it directly instead of StringFile inside FlushChannelRecord.
This would reduce memory usage, eliminate yet another memory copy and generally would make everything simpler.
For that to work, we must serialize the order of FlushChannelRecord, and that's implemented by
this PR. Also fixes #3658 .
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-09-09 06:19:04 +00:00
Daniel M
eef5be1729
test: remove redundant tests ( #3642 )
...
* test: remove redundant tests
* remove more tests
* add test_bitmap_commands
* add test_bitmap_commands and test_geo_commands to ignore list
2024-09-04 23:55:35 +03:00
Roman Gershman
e6f5a2073c
fix: crash when passing empty arguments ( #3627 )
...
* fix: crash when passing empty arguments
Fix the case where we pass an empty argument, which then is parsed as an
empty string view with null pointer. The null pointer is not handled correctly
by our low level c code, hence switch to using ""sv for that.
* chore: add more list asserts + improve test_hypothesis
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-09-03 12:43:12 +03:00
Roman Gershman
1a0d44354f
fix: limit parsing in zrange commands ( #3626 )
...
1. The offset value can be negative, in that case we should return an empty array.
2. Fix edge cases of inf*0 and -inf + inf, so they will result in 0 and non NaN (similarily to Valkey).
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-09-03 10:08:45 +03:00
Roman Gershman
10de338926
chore: run fakeredis flow with the debug build ( #3612 )
...
1. Fix html publishing code
2. Upload dragonfly logs
3. Run it on pull requests
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-09-01 14:51:00 +03:00
Roman Gershman
20336805f3
chore: enable experimental_new_io by default. ( #3605 )
...
* chore: enable experimental_new_io by default.
It has been running for weeks with the flag on, so enabled it also for community.
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
Co-authored-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-08-29 23:30:26 +03:00
Daniel M
a66cbe150e
fix: fakeredis tests support python 3.10 ( #3550 )
...
* fix:change to py3.10
* fix:change to py3.10
2024-08-23 22:31:35 +03:00
Daniel M
e3016a6f83
test: tests using fakeredis to check compatibility ( #3534 )
...
* fakeredis tests
2024-08-22 22:30:42 +03:00
Vladislav
1f36c9952d
chore(io): Introduce (carefully) new io with use_new_io flag ( #3513 )
...
Plugs in new IO, must be reverted after successful testing
2024-08-16 16:56:04 +03:00
Kostas Kyrimis
d37c2ec85a
fix: pytest warnings ( #3497 )
...
* fix truncating the timeout red dots on CI failures
* fix deprecated use of with timeout warnings
* remove @pytest.mark.dbg_only as it doesn't exist
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-08-13 16:05:15 +03:00
