Abhradeep Chakraborty
561c0a4733
feat(github-workflow): upload dev binaries to artifact buckets ( #5031 )
...
* feat(github-workflow): upload dev binaries to gcs artifact bucket
Signed-off-by: Abhradeep Chakraborty <abhradeep@dragonflydb.io>
2025-05-09 11:38:26 +03:00
Kostas Kyrimis
ad946d8e06
chore: add dfly_bench to release workflow ( #5045 )
...
* upload dfly_bench binaries on every release
* fix macos failing build
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-05-02 22:34:37 +03:00
Roman Gershman
23e6db900d
fix: regtest failures ( #5013 )
...
1. Fix a crash bug in RESETSTAT when number of shards is less than number of threads.
2. Tune regtests parameters for pipelining tests to pass.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2025-04-28 12:49:44 +03:00
Kostas Kyrimis
71dd189ebd
chore: split unit test steps in ci workflow ( #5002 )
...
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-04-25 20:14:04 +03:00
Daniel M
c06e154d43
Fix test hypothesis ( #4927 )
...
* fix:test-hypothesis
---------
Co-authored-by: Roman Gershman <roman@dragonflydb.io>
2025-04-23 18:11:37 +03:00
Abhijat Malviya
1b0aa56028
Add workflow to run mastodon ruby test suite ( #4946 )
...
initial version of mastodon test
Signed-off-by: Abhijat Malviya <abhijat@dragonflydb.io>
2025-04-22 13:08:07 +05:30
Roman Gershman
95147fbb59
fix: broken gha cache ( #4951 )
...
* fix: broken gha cache
Also fix some clang warnings.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
* chore: comments
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2025-04-17 08:30:58 +03:00
Kostas Kyrimis
7adb071f2a
fix: test_replica_snapshot_with_big_values_while_seeding ( #4902 )
...
* throttle the test to require less memory
* increase reg test timeout on the ci from 50 to 60 mins
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-04-09 08:20:58 +00:00
Volodymyr Yavdoshenko
3eb8417453
fix: docker release should be updated latest version using semantic version of latest tag ( #4887 )
...
fixed: https://github.com/dragonflydb/dragonfly/issues/4831
2025-04-06 14:01:39 +03:00
Abhradeep Chakraborty
30ce734cd2
feat(docker): push dragonfly image to gcp artifact registry ( #4716 )
...
* feat(docker): push dragonfly image to gcp aritfact registry
---------
Signed-off-by: Abhradeep Chakraborty <abhradeep@dragonflydb.io>
2025-03-25 10:50:01 +02:00
adiholden
7c2051ef71
CI: add slow regression tests ( #4646 )
...
Signed-off-by: adi_holden <adi@dragonflydb.io>
2025-02-27 09:01:57 +00:00
adiholden
a213d96b6c
server: disable single shard tx optimization on scheduling ( #4647 )
...
Signed-off-by: adi_holden <adi@dragonflydb.io>
2025-02-26 14:02:54 +02:00
Roman Gershman
fc65a1acfd
fix: bring back the helm step to docker release action ( #4657 )
...
Also, add the missing notifications.
Fixes #4633
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2025-02-25 11:42:12 +02:00
Kostas Kyrimis
19892d9775
chore: implement sharded pub/sub ( #4518 )
...
* add sharded pub/sub
* add slot check logic for pub sub messages
* add test
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-02-19 11:39:24 +02:00
Roman Gershman
52d88c2372
chore: introduce docker release pipeline ( #4618 )
...
* chore: introduce docker release pipeline
The whole flow is reimplemented using native arm64/amd64 runners.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
* Update .github/workflows/docker-release2.yml
Co-authored-by: Kostas Kyrimis <kostas@dragonflydb.io>
Signed-off-by: Roman Gershman <romange@gmail.com>
* chore: comments
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
Signed-off-by: Roman Gershman <romange@gmail.com>
Co-authored-by: Kostas Kyrimis <kostas@dragonflydb.io>
2025-02-17 12:24:24 +02:00
Kostas Kyrimis
fe0da9c013
chore: use macos-14 for the daily macos build ( #4609 )
...
* try macos-14
2025-02-17 10:15:26 +02:00
Kostas Kyrimis
c8c1eaee9e
fix: epoll reg tests running on iouring ( #4612 )
...
* properly run epoll instead of iouring
* fix print message on failure
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-02-17 09:30:35 +02:00
Roman Gershman
acde373709
fix: a regex bug with escaping inside of character classes ( #4575 )
...
Also delete the broken docker weekly flow.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2025-02-07 10:42:45 +00:00
Shahar Mike
47a1305ea1
Fix BullMQ tests workflow in GitHub actions ( #4565 )
...
Squash
Co-authored-by: shahar <shahar@dragonflydb.io>
2025-02-05 13:56:52 +00:00
Roman Gershman
6d1c22b64c
chore: GlobMatcher uses now reflex::Matcher regex engine ( #4528 )
...
Also consolidate benchmarking low level routines undeer dfly_core_test
```
BM_ParseFastFloat 707 ns 707 ns 4005656
BM_ParseDoubleAbsl 1460 ns 1460 ns 1927158
BM_MatchGlob/1000 121 ns 121 ns 23701780
BM_MatchGlob/10000 512 ns 512 ns 5481405
BM_MatchFindSubstr/1000 123 ns 123 ns 31114255
BM_MatchFindSubstr/10000 1126 ns 1126 ns 2522019
BM_MatchReflexFind/1000 118 ns 118 ns 22442417
BM_MatchReflexFind/10000 512 ns 512 ns 5414329
BM_MatchReflexFindStar/1000 106 ns 106 ns 26276727
BM_MatchReflexFindStar/10000 717 ns 717 ns 3719605
BM_MatchStd/1000 19782 ns 19779 ns 128020
BM_MatchStd/10000 199809 ns 199781 ns 13837
BM_MatchRedisGlob/1000 1601 ns 1601 ns 1754635
BM_MatchRedisGlob/10000 16494 ns 16493 ns 171585
BM_MatchRe2/1000 1039 ns 1039 ns 2709486
BM_MatchRe2/10000 10041 ns 10040 ns 281296
```
What's curious is that now matching `*foobar*` on string is faster than
searching for 'foobar` using string::find() (BM_MatchGlob vs BM_MatchFindSubstr)
Improvement vs Redis is 10-30 times faster (BM_MatchRedisGlob vs BM_MatchGlob).
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2025-02-05 10:29:51 +02:00
Kostas Kyrimis
abe3306abd
chore: remove clang install step from ci workflow ( #4550 )
...
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-02-04 15:00:07 +02:00
Borys
c95ad19830
chore: update release build for arm ( #4519 )
...
fix: release build for arm
2025-01-30 12:56:47 +00:00
Kostas Kyrimis
c05d1cafc8
chore(ci): report proactor kind on reg test failure ( #4531 )
...
* include epoll or iouring on notification failures
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-01-30 14:24:32 +02:00
Roman Gershman
fc94b2c265
chore: add more logs to the op_manager code ( #4527 )
...
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2025-01-29 19:08:41 +02:00
dependabot[bot]
d945b831db
chore(deps): bump github/codeql-action from 3.28.0 to 3.28.5 in the actions group across 1 directory ( #4514 )
...
chore(deps): bump github/codeql-action
Bumps the actions group with 1 update in the / directory: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.28.0 to 3.28.5
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](48ab28a6f5...f6091c0113
)
---
updated-dependencies:
- dependency-name: github/codeql-action
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: actions
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-28 08:57:24 +02:00
Kostas Kyrimis
e5da019419
chore: split epoll/uring reg test flows ( #4512 )
...
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-01-27 11:14:07 +02:00
Roman Gershman
904775cfe6
chore: new docker build pipeline ( #4503 )
...
Our previous weekly pipeline used qemu, was very slow and over-complicated.
This one uses matrix with proper parallelization and the latest arm64 github runners.
now it takes less than 30 minutes to build everything.
lets make it daily.
2025-01-26 12:03:42 +02:00
Kostas Kyrimis
4a2f2e3d04
chore: add sanitizers to ci workflow ( #4462 )
...
* chore: add sanitizers to ci workflow
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-01-22 12:00:10 +02:00
Kostas Kyrimis
85cc443448
chore: run regression tests with epoll ( #4426 )
...
* chore: run regression tests with epoll
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-01-20 14:18:21 +02:00
Shahar Mike
6f3c6e3d57
chore: Fix all clang build warnings ( #4475 )
...
* chore: Fix all clang build warnings
Also add `-Werror` to clang build in CI.
Fixes #4449
* all build targets
* fix search test
2025-01-20 10:24:07 +02:00
Kostas Kyrimis
c759eb8ce6
chore: replace deprecated HELIO_STACK_CHECK ( #4465 )
...
* remove HELIO_STACK_CHECK
* use FLAGS_fiber_safety_margin
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2025-01-20 10:17:24 +02:00
Daniel M
6f0072e462
Fix test hypothesis ( #4380 )
...
* fix:test-hypothesis
---------
Co-authored-by: Roman Gershman <roman@dragonflydb.io>
2025-01-17 07:59:44 +02:00
Kostas Kyrimis
0eff6c93f2
fix(ci): sanitizers build ( #4457 )
...
* compile with clang
* update container to version 24
* move to x86 github runner ubuntu 24
* use compiler-rt instead of libgcc
* add cmake glue
2025-01-15 12:39:43 +02:00
Roman Gershman
ff4add0c9e
chore: deprecate unneeded runtime flags ( #4405 )
...
Deprecate multi_exec_mode and track_exec_frequencies.
Remove duplicated call to EnterLameDuck (done also in Service::Shutdown()).
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2025-01-05 13:31:59 +00:00
adiholden
0f5eb33e6a
chore(pytest): add timeout per test ( #4404 )
...
regression action add 5 minutes timeout per test
Signed-off-by: adi_holden <adi@dragonflydb.io>
2025-01-05 13:19:13 +02:00
dependabot[bot]
c88c707341
chore(deps): bump the actions group across 1 directory with 2 updates ( #4361 )
...
Bumps the actions group with 2 updates in the / directory: [mozilla-actions/sccache-action](https://github.com/mozilla-actions/sccache-action ) and [github/codeql-action](https://github.com/github/codeql-action ).
Updates `mozilla-actions/sccache-action` from 0.0.6 to 0.0.7
- [Release notes](https://github.com/mozilla-actions/sccache-action/releases )
- [Commits](https://github.com/mozilla-actions/sccache-action/compare/v0.0.6...v0.0.7 )
Updates `github/codeql-action` from 3.27.5 to 3.28.0
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](f09c1c0a94...48ab28a6f5
)
---
updated-dependencies:
- dependency-name: mozilla-actions/sccache-action
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: actions
- dependency-name: github/codeql-action
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: actions
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Roman Gershman <roman@dragonflydb.io>
2024-12-25 05:30:59 +02:00
Roman Gershman
95cd9dfb4c
chore: update helio and improve our stack overflow resiliency ( #4349 )
...
1. Run CI/Regression tests with HELIO_STACK_CHECK=4096.
This will crash if a fiber stack usage goes below this limit.
2. Increase shard queue stack size to 64KB
3. Increase fiber stack size to 40KB on Debug builds.
4. Updated helio has some changes around the TLS socket code.
In addition we add a helper script to generate self-signed certificates helpful for local development work.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-12-23 08:13:45 +00:00
Roman Gershman
a87d6aecef
chore: fully support qlist in all list_family commands ( #4201 )
...
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-27 13:56:56 +02:00
dependabot[bot]
5c84f21caf
chore(deps): bump github/codeql-action from 3.27.4 to 3.27.5 in the actions group ( #4186 )
...
chore(deps): bump github/codeql-action in the actions group
Bumps the actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.27.4 to 3.27.5
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](ea9e4e3799...f09c1c0a94
)
---
updated-dependencies:
- dependency-name: github/codeql-action
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: actions
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-26 10:04:40 +02:00
Roman Gershman
2c663f3833
chore: produce core files in regtests ( #4185 )
...
Should work only for self-hosted runners.
The core files will be kept in /var/crash/
We also copy automatically dragonfly binary into /var/crash to be able to debug later.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-25 17:13:11 +00:00
Tarun Pothulapati
3d68c9c99e
fix(release/helm): allow empty commits for rerun ( #4163 )
...
* fix(release/helm): allow empty commits for rerun
* remove empty commit and just move forward
2024-11-25 08:29:10 +00:00
dependabot[bot]
907346e3e6
chore(deps): bump github/codeql-action from 3.27.1 to 3.27.4 in the actions group ( #4148 )
...
chore(deps): bump github/codeql-action in the actions group
Bumps the actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.27.1 to 3.27.4
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](4f3212b617...ea9e4e3799
)
---
updated-dependencies:
- dependency-name: github/codeql-action
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: actions
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-18 23:05:42 +02:00
Daniel M
d241839cff
chore:update fakeredis, remove irrelevant tests ( #4014 )
...
* chore:update fakeredis, remove irrelevant tests
2024-11-17 20:24:46 +02:00
dependabot[bot]
a887d822a9
chore(deps): bump github/codeql-action from 3.27.0 to 3.27.1 in the actions group ( #4115 )
...
chore(deps): bump github/codeql-action in the actions group
Bumps the actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.27.0 to 3.27.1
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](662472033e...4f3212b617
)
---
updated-dependencies:
- dependency-name: github/codeql-action
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: actions
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-14 19:28:25 +02:00
Blanky
43060ba79e
chore(dependabot): Allows only security patches ( #4075 )
...
* feat(dependabot): Add dependabot to check for vulnerabilies and update dependencies
---------
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
Signed-off-by: Blanky <131886247+BLANKatGITHUB@users.noreply.github.com>
2024-11-08 08:08:33 +02:00
dependabot[bot]
aa4a61894d
chore(deps): bump docker/build-push-action from 5 to 6 ( #4055 )
...
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 5 to 6.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](https://github.com/docker/build-push-action/compare/v5...v6 )
---
updated-dependencies:
- dependency-name: docker/build-push-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:38:06 +02:00
dependabot[bot]
d6ec5910d1
chore(deps): bump github/codeql-action from 3.24.9 to 3.27.0 ( #4054 )
...
Bumps [github/codeql-action](https://github.com/github/codeql-action ) from 3.24.9 to 3.27.0.
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](1b1aada464...662472033e
)
---
updated-dependencies:
- dependency-name: github/codeql-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:37:51 +02:00
dependabot[bot]
8dc12a39e5
chore(deps): bump ossf/scorecard-action from 2.3.1 to 2.4.0 ( #4053 )
...
Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action ) from 2.3.1 to 2.4.0.
- [Release notes](https://github.com/ossf/scorecard-action/releases )
- [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md )
- [Commits](0864cf1902...62b2cac7ed
)
---
updated-dependencies:
- dependency-name: ossf/scorecard-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:37:07 +02:00
dependabot[bot]
f67103f9b0
chore(deps): bump mozilla-actions/sccache-action from 0.0.4 to 0.0.6 ( #4051 )
...
Bumps [mozilla-actions/sccache-action](https://github.com/mozilla-actions/sccache-action ) from 0.0.4 to 0.0.6.
- [Release notes](https://github.com/mozilla-actions/sccache-action/releases )
- [Commits](https://github.com/mozilla-actions/sccache-action/compare/v0.0.4...v0.0.6 )
---
updated-dependencies:
- dependency-name: mozilla-actions/sccache-action
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:36:20 +02:00
dependabot[bot]
18f7d9bbd5
chore(deps): bump mikepenz/action-junit-report from 4 to 5 ( #4052 )
...
Bumps [mikepenz/action-junit-report](https://github.com/mikepenz/action-junit-report ) from 4 to 5.
- [Release notes](https://github.com/mikepenz/action-junit-report/releases )
- [Commits](https://github.com/mikepenz/action-junit-report/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: mikepenz/action-junit-report
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:35:47 +02:00