Commit graph

2196 commits

Author SHA1 Message Date
adiholden
b2213b05d1
fix(replication): fullsync phase write to sync on noop (#3084)
* fix replication: fullsync phase write to sync on noop

Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-05-27 17:52:07 +03:00
adiholden
c45f7bfea5
feat(server): remove multi shard sync from replication (#3085)
feat server: remove multi shard sync from replication

Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-05-27 14:44:37 +03:00
Vladislav
3474eebbb7
chore(streams): Some refactoring (#3088)
* chore: small refactor

* chore: refactor replies

* chore: introduce HasEntries()
2024-05-27 13:36:48 +03:00
Shahar Mike
07b5e00424
feat(server): Expose serialization bytes via INFO and /metrics (#3087)
* feat(server): Expose serialization bytes via `INFO` and `/metrics`

* Also expose pipeline_cmd_cache_bytes via `/metrics` (it's already in `INFO`)
2024-05-27 07:15:51 +00:00
Kostas Kyrimis
2391f49e1c
fix(acl): return -NOPERM instead of response error (#3049) 2024-05-27 09:25:54 +03:00
Borys
0dea257f41
fix: fix cluster incorrect keys status (#3083)
* fix: fix cluster incorrect keys status
2024-05-26 15:10:01 +03:00
Roman Gershman
5534ee5c23
chore: minor fixes (#3082)
1. script errors are now logged continously but at most 5 per second.
2. "memory arena" is introduced - it prints the arena stats per thread.
   "memory malloc-stats" now only prints the global stats.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-26 10:14:02 +03:00
Roman Gershman
20c98c29c1
fix: increase lua stack limit to 8KB (#3080)
Before that 'lua_checkstack(lua(), 7000)' would not pass because we limited lua stack to 4KB.
7000 is the max limit used by bullmq, so we raising it to support this case.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-25 23:11:27 +03:00
Vladislav
fd5ece09fb
chore: small replayer fixes (#3081) 2024-05-25 22:48:29 +03:00
Vladislav
42500c3d1e
fix(tiering): wait for IO before test teardown (#3079)
* chore: wait for IO before test teardown

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-25 20:05:47 +03:00
Vladislav
82d8b02348
chore: bpop prints (#3076)
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-25 11:11:18 +03:00
Roman Gershman
8a0007d761
chore: add replication memory stats to the dashboard (#3065) 2024-05-22 08:11:54 +03:00
Jirapong Pansak
3babe99cf6
<chore>!: Update grafana panel (#3064)
update panel
2024-05-19 15:56:44 +00:00
Roman Gershman
fd74fd5b4b
chore: Export replication memory stats (#3062) 2024-05-18 22:40:14 +03:00
Roman Gershman
9d623d0f4b
chore: remove unneeded check-fails (#3054) 2024-05-16 18:45:26 +03:00
romange
d73ffc27b9 chore(helm-chart): update to v1.18.1 2024-05-16 13:22:25 +00:00
Roman Gershman
494ccdf2c6
chore: update deprecated actions (#3052) 2024-05-16 13:02:10 +03:00
Roman Gershman
73e44a941e
chore: reset enable_direct_fd to avoid socket leakage in kernel (#3051)
The leakage can be identified by checking /proc/net/sockstat
Fixes #3045

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-16 09:44:53 +03:00
Roman Gershman
6b8a8b6410
fix: header for oom_errors_total (#3043) 2024-05-13 14:00:47 +03:00
Roman Gershman
5bf7e3b146
chore: update helio together with new mimalloc version (#3040)
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-13 12:48:05 +03:00
Roman Gershman
8721ca7fca
chore: add half-range indices (#3041)
Add indices in form of [:end] or [start:]
Also, enable jsonpathv2 by default

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-13 10:30:58 +03:00
Roman Gershman
3e0a9e16cc
chore: prevent updating gcc on macos (#3037)
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-13 10:30:42 +03:00
Stepan Bagritsevich
d3a585113f
fix(set): fix random in SRANDMEMBER and SPOP commands (#3022)
Signed-off-by: Stepan Bagritsevich <sbagritsevich@quantumbrains.com>
2024-05-13 10:08:01 +03:00
Borys
4cd142d42c
fix: reduce delay when stop replica #3020 (#3028)
* fix: reduce delay when stop replica #3020
2024-05-12 17:30:06 +03:00
Roman Gershman
a9956e9723
feat: support subrange expressions in jsonpathv2 (#3036)
Support for expressions like `$.arr[1:-2]`.

The change applies to our own implementation of jsonpath,
jsoncons already supports this format.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-11 22:30:55 +03:00
Vladislav
b7fdc41d2e
chore: fix macos tiering (#3032) 2024-05-09 14:46:14 +00:00
romange
ab2ce0fef8 chore(helm-chart): update to v1.18.0 2024-05-09 08:44:05 +00:00
Roman Gershman
b3c08a3eb1
chore: update versions and remove caching code (#3030) 2024-05-09 11:39:41 +03:00
Borys
3dd6c4959c
feat: add defragment command (#3003)
* feat: add defragment command and improve auto defragmentation algorithm
2024-05-08 14:26:42 +03:00
Vladislav
d675e63ab0
chore(dash): Replace comparator with predicate (#3025)
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-08 13:03:15 +03:00
Roman Gershman
25e6930ac3
Revert "chore: get rid of kv_args and replace it with slices to full_… (#3024)
Revert "chore: get rid of kv_args and replace it with slices to full_args (#2942)"

This reverts commit de0e5cb0bd.
2024-05-08 03:01:37 +03:00
Vladislav
5c4279c285
feat(tiering): MGET support (#3013)
* feat(tiering): MGET support

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-07 23:13:36 +03:00
Vladislav
f27506e678
feat(tiering): simple offload loop (#2987)
Simple offloading for tiering

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-06 22:28:45 +03:00
Vladislav
8697b20a9e
chore: Remove tiering test skip (#3011)
chore: reduce test limits

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-06 21:19:54 +03:00
adiholden
186ff31e29
Fix benchmark (#3017)
* fix(benchmark): fix lag check

Signed-off-by: adi_holden <adi@dragonflydb.io>

---------

Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-05-06 18:38:13 +03:00
Stepan Bagritsevich
7d522fd00b
fix(zset): fix random in ZRANDMEMBER command (#2994)
fixes dragonflydb#2850

Signed-off-by: Stepan Bagritsevich <sbagritsevich@quantumbrains.com>
2024-05-06 18:22:25 +03:00
adiholden
a4f67fbfad
fix(server): shrink replication steaming buf (#3012)
* fix server: shrink replication steaming buf


Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-05-06 15:06:23 +00:00
adiholden
dd80d06be5
fix(server): non auto journal write after callback finish (#3016)
fix server: non auto journal write after callback finish

Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-05-06 17:18:51 +03:00
Roman Gershman
de0e5cb0bd
chore: get rid of kv_args and replace it with slices to full_args (#2942)
The main change is in tx_base.* where we introduce ShardArgs slice that
is only forward iterable. It allows us to go over sub-ranges of the full arguments
slice or read an index of any of its elements.

Since ShardArgs provide now indices into the original argument list we do not need to build the reverse index in transactions.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-06 15:53:30 +03:00
adiholden
135af96f2f
fix(server): lag is 0 when server not in stable state (#3010)
* fix server: lag is 0 when server not in stable state

Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-05-06 10:17:11 +03:00
Roman Gershman
816cec12ed
chore: pull latest helio (#3009)
Also clean-up unused flags.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-05 22:43:59 +03:00
Shahar Mike
9f6b716b47
feat(lua): Add Lua stats to INFO STATS and /metrics (#3008)
* feat(lua): Add Lua stats to `INFO STATS` and `/metrics`

Stats include:
1. Interpreter count
2. Interpreter bytes
3. Time spent blocked waiting for an available interpreter

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-05 20:19:17 +03:00
Roman Gershman
186f4bcdca
chore: export listener stats (#3007)
* chore: export listener stats

Specifically export reached maxclient event.

---------

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-05 13:28:37 +03:00
Vladislav
5d66e2f123
chore: fix tiering macos stub (#3006) 2024-05-03 19:13:17 +00:00
Vladislav
9e3748421b
fix(tiering): rename v2 + max_file_size (#3004)
* fix: rename + max_file_size

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-03 21:36:18 +03:00
Zacharya
6b480237be
Benchmark fixes (#3005)
* fix(benchmark): depcreated node 16 github actions
2024-05-03 19:53:45 +03:00
Zacharya
5a37c47aaf
feat(benchmark-tests): run in K8s (#2965)
Signed-off-by: adi_holden <adi@dragonflydb.io>

* feat(benchmark-tests): run in K8s

---------

Signed-off-by: adi_holden <adi@dragonflydb.io>
Co-authored-by: adi_holden <adi@dragonflydb.io>
2024-05-03 15:12:15 +00:00
Vladislav
08983c181f
chore: small tiering fixes (#2966)
* chore: tiering fixes

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-02 18:00:46 +00:00
Roman Gershman
10cf2b677b
chore: fix double header issue (#3002)
As reported on discord:
"text format parsing error in line 31: second TYPE line for metric name"

Also, improved consistency between other headers and their values.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-02 17:27:03 +03:00
Shahar Mike
082aba02ef
fix(cluster-migration): Support cancelling migration right after starting it (#2992)
* fix(cluster-migration): Support cancelling migration right after starting it

This fixes a few small places, but most importantly it does not allow a
migration to start before both the outgoing and incoming side received
the updated config. This solves a few edge cases.

Fixes #2968

* add TODO

* fix test

* gh comments and fixes

* add comment
2024-05-02 15:50:42 +03:00