Commit graph

1407 commits

Author SHA1 Message Date
Shahar Mike
b91435e360
opt(lua): Coordinate single-shard Lua evals in remote thread (#1845)
* opt(lua): !!WIP!! Coordinate single-shard Lua evals in remote thread

This removes the need for an additional (and costly) Fiber.
2023-09-13 11:52:35 +03:00
Roy Jacobson
ef0502238c
fix(tls): User friendly logging of OpenSSL errors (#1851)
* fix(tls): User friendly logging of OpenSSL errors

* Remove duplicate definition
2023-09-13 11:23:18 +03:00
Roman Gershman
761a1a7e78
Fix a potential crash in OnBreakCb (#1850)
I am not sure about the root cause of this flow but we can definitely
avoid a check-fail here.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-09-13 11:18:32 +03:00
adiholden
55710e40f3
chore(regression): send chat notificaiton only on main branch (#1847)
* chore(regression): send chat notificaiton only on main branch

Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-09-13 09:17:02 +03:00
Roman Gershman
99244b1049
Support 'databases' alias for CONFIG GET (#1849)
Fixes #1842

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-09-12 19:19:05 +03:00
Roman Gershman
02fff36e3e
Add build_rpm script and rpm spec (#1831)
Also, link stdlib++ and libgcc statically.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-09-12 10:42:06 +03:00
Kostas Kyrimis
684bf97ce6
fix(AclFamily): move acl test files to pytest (#1843)
* Fixes broken release build
* Moves acl test files to acl pytest
2023-09-12 09:38:58 +03:00
Andy Dunstall
9fac9a7ace
feat(snapshot): move load path to snapshot storage (#1830)
* feat(snapshot): move snapshot storage to new file

* feat(snapshot): move file load path to snapshot storage

* feat(snapshot): move load paths to snapshot storage

* feat(snapshot): move open read file to snapshot storage

* feat(snapshot): remove redundant includes from save stages controller

* feat(snapshot): remove sv string literal
2023-09-11 07:41:13 +01:00
Borys
fcebb6acd0
fix(search-parser): fix AND, OR, NOT parsing issue (#1838)
Signed-off-by: Borys <borys@anyconnect.com>
2023-09-10 15:11:34 +03:00
adiholden
ba8adf7bde
skip test_multidim_knn (#1834)
Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-09-10 08:35:42 +00:00
Roy Jacobson
c18aa1c317
Revert "feat(CI): Configure sccache to work with GCS" (#1833)
Revert "feat(CI): Configure sccache to work with GCS (#1815)"

This reverts commit f3c4132ab6.
2023-09-10 08:11:26 +00:00
Roy Jacobson
f3c4132ab6
feat(CI): Configure sccache to work with GCS (#1815)
* feat(CI): Configure sccache to work with GCS

* Lower sccache log level now that it's working.
2023-09-10 10:23:51 +03:00
Kostas Kyrimis
fc6b7e5f9a
fix(regression-tests): correct path for acl files (#1829) 2023-09-09 11:59:17 +03:00
Kostas Kyrimis
164b045505
fix: regression tests for acl family test (#1826) 2023-09-08 19:57:09 +03:00
Andy Dunstall
9d45ddd9fe
feat(snapshot): add snapshot storage (#1827)
* feat(snapshot): add snapshot storage

* feat(snapshot): replace snapshot storage open file output variables
2023-09-08 17:12:13 +01:00
Kostas Kyrimis
48488c5682
feat(AclFamily): load/store aclfile (#1820)
* add ACL LOAD
* add ACL SAVE
* add --aclfile command
2023-09-08 14:20:06 +03:00
Vladislav
80ec976214
Revert "chore: partially revert adjust batching behavior to reduce network" (#1824)
Revert "chore: partially revert adjust batching behavior to reduce network (#1821)"

This reverts commit 55737a6f05.
2023-09-08 14:19:28 +03:00
Vladislav
257e789d37
fix: Reply within async_dispatch block in squashed pipeline (#1825)
* fix: Reply within async_dispatch block in squashed pipeline

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2023-09-08 14:19:16 +03:00
Andy Dunstall
8b5635eae8
fix(aws): initialise aws in a proactor (#1818)
* fix(aws): initialise aws in a proactor

* chore: update helio
2023-09-08 09:07:08 +01:00
Roman Gershman
29e154923f
fix: possible segfault bug (#1822)
A user reported crash in Connection::GetClientInfo function.
When connection just start running, its phase_ variable was not
initialized, so a possible "CLIENT LIST" command from another connection
could trigger invalid data access when printing phase_.
To be on the safe side I also verify that other pointers in the function
are set (could also be that we have a similar issue during connection shutdown).

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-09-08 10:21:05 +03:00
Vladislav
e69f18286b
feat(search): HNSW (#1799)
* feat(search): HNSW

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2023-09-08 09:57:18 +03:00
Kostas Kyrimis
55737a6f05
chore: partially revert adjust batching behavior to reduce network (#1821)
* partially reverts #1777
2023-09-08 09:45:44 +03:00
yancz
fb5ae98a4e
docs: update README.zh-CN.md (#1772)
* Update README.zh-CN.md

Signed-off-by: yancz2000 <yancz2000@163.com>

* Update README.zh-CN.md

Signed-off-by: yancz2000 <yancz2000@163.com>

* Update README.zh-CN.md

Signed-off-by: yancz <yancz2000@163.com>

---------

Signed-off-by: yancz2000 <yancz2000@163.com>
Signed-off-by: yancz <yancz2000@163.com>
2023-09-07 20:46:10 -04:00
Abhradeep Chakraborty
16c9502d02
feat(stream): add support for xclaim command (#1372)
* feat(stream): add support for xclaim command

Signed-off-by: Abhradeep Chakraborty <abhradeep@dragonflydb.io>

* add retrycount test

Signed-off-by: Abhradeep Chakraborty <abhradeep@dragonflydb.io>

---------

Signed-off-by: Abhradeep Chakraborty <abhradeep@dragonflydb.io>
2023-09-07 11:35:28 +00:00
Kostas Kyrimis
30b8bcad4e
chore(AclFamily): remove unused using decl from acl_family_test (#1817) 2023-09-07 12:36:20 +03:00
Abhradeep Chakraborty
3b81cd74c9
feat(stream): add support for xpending command (#1806)
* feat(stream): add support for xpending command

---------

Signed-off-by: Abhradeep Chakraborty <abhradeep@dragonflydb.io>
2023-09-06 20:55:03 +03:00
Kostas Kyrimis
d1002842b8
chore(AclFamily): Move some of the regressions tests to unit and add (#1816)
* move error handling tests from regression to unit
* move ACL LIST regression to unit test
* move AUTH regression to unit test
* move ACL WHOAMI regression to unit test
* add unit tests for SETUSER/DELUSER (so they run on every PR)
* add unit tests for all ACL categories
2023-09-06 16:03:22 +00:00
adiholden
d1bce6978d
bug(server): multi cleanup on error (#1813)
the bug: when returning error on a command in multi tx we do not cleanup
the multi cntx
the fix: cleanup the cntx when error is returned

Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-09-06 13:02:57 +00:00
Vladislav
e0af5fe836
Remove ICU library (#1812)
* chore(search): Replace icu with unialgo

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2023-09-06 15:06:38 +03:00
Yue Li
a8e4bebffe
feat (hset): Support arguments (count, withvalues) in HRANDFIELD (#1804)
feat (hset): Support arguments (count, withvalues) in HRANDFIELD

fixes #858
2023-09-06 09:04:36 +00:00
Roman Gershman
4e393cf742
fix: alpine weekly pipeline (#1811)
1. Move docker build files to separate dir from docker script files
   so that they won't be part of build context. Update dockerignore as well
2. Fix lib dependencies for alpine

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-09-06 08:27:40 +00:00
Vladislav
aa4cadfa12
feat(search): sized vectors (#1788)
* feat(search): Sized vectors

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2023-09-06 11:00:03 +03:00
Roman Gershman
36be222091
chore: add macos daily build (#1795)
It compiles most of the code though some linking problems still exist.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-09-06 09:35:11 +03:00
romange
b8a9d1f093 chore(helm-chart): update to v1.9.0 2023-09-05 14:33:11 +00:00
Vladislav
05f4895d48
Update Dockerfile.alpine-dev (#1803)
Add missing icu dependency

Signed-off-by: Vladislav <vlad@dragonflydb.io>
2023-09-05 08:44:11 +00:00
Roman Gershman
87a47564ea
fix: add maxmemory_policy item to info memory section (#1802)
Fixes #1800.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-09-05 10:39:45 +03:00
Roy Jacobson
1963756111
fix: Add missing encodings to strEncoding (#1798) 2023-09-04 21:43:20 +03:00
Roy Jacobson
f94c4bef8b
fix(server): Adjust batching behavior to reduce network latency on MULTI blocks (#1777)
* 1. Add a Yield() call before executing the last command in the async queue when needed.
2. Allow the receive buffer to grow when needed.
3. Improve debugging logs for batching behavior.

* Update helio and use the new epoch interface for deciding on yields.
2023-09-04 15:29:17 +03:00
Roy Jacobson
502f76fada
Enable authentication for the HTTP interface. (#1792) 2023-09-04 15:18:57 +03:00
Vladislav
f1d9ab30ee
feat(search): Query parameters (#1768)
* feat(search): Query parameters

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2023-09-03 23:08:25 +03:00
Roman Gershman
cc828f238f
chore: Update double-conversion library (#1793)
Add double to string coversion tests.
Patch the library to avoid using locale - because freebsd c++ lib
does not have this symbol.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-09-03 16:18:43 +03:00
Roman Gershman
e8bf54e8bb
chore: dragonfly compiles on FreeBSD (#1789)
1. Do not use IOUring on non-linux systems.
2. Improve compatibility of the code for non-linux systems.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-09-03 14:11:08 +03:00
Vladislav
5af6169729
feat(search): FT.PROFILE (#1787)
* feat(search): Profiling

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2023-09-03 12:39:31 +03:00
Kostas Kyrimis
196650a39d
chore(AclFamily): disable flaky tests (#1791) 2023-09-03 09:23:14 +00:00
Kostas Kyrimis
846d421d25
fix(AclFamily): setuser interleaved signed categories update (#1790) 2023-09-03 09:02:32 +00:00
adiholden
ac3b8b2b74
fix(server): Dont apply memory limit when loading/replicating (#1760)
* fix(server): Dont apply memory limit when loading/replicating

When loading a snapshot created by the same server configuration (memory and
number of shards) we will create a different dash table segment directory tree, because the
tree shape is related to the order of entries insertion. Therefore when loading data from
snapshot or from replication the conservative memory checks might fail as the new tree might
have more segments. Because we dont want to fail loading a snapshot from the same server
configuration we disable this checks on loading and replication.

Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-09-03 11:24:52 +03:00
Roman Gershman
7c16329ef3
fix: account for huge pages when displaying RSS usage (#1785)
now used_memory_rss is computed correctly.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-09-02 12:36:56 +03:00
Kostas Kyrimis
68fa3f420b
feat(AclFamily): add acl whoami command (#1774)
* add acl whoami
* add tests
2023-09-01 21:23:01 +03:00
Kostas Kyrimis
6706707585
feat(AclFamily): add acl deluser (#1773)
* add acl deluser command
* add tests
2023-09-01 16:12:02 +00:00
Kostas Kyrimis
9ca7dba143
fix(AclFamily): stream acl updates via dispatch queue in connection (#1786)
There was a bug on updates of the acl categories when squashing was used. Basically, the parent context could be accessed in parallel by the "stub" contexts causing a dreaded data race on the update.

This is fixed by adding a new AclUpdateMessage at the front of the dispatch queue of the connection.
2023-09-01 15:40:50 +00:00