Commit Graph

213 Commits

Author SHA1 Message Date
yu yunfeng
2ab5e246ac add metrics
Former-commit-id: d7acd398be8aeee11de3f972d9bcf6e84df39358
2019-05-31 14:36:36 +08:00
yu yunfeng
f8c46af560 fix metrics test and add prometheus conf
Former-commit-id: 0c7ff6f49880db0ce4dd22ea1375886fb0e9b03d
2019-05-30 14:50:16 +08:00
groot
39df2d4d1e fix third-party link error
Former-commit-id: 54782a2d0812e836544ca8667c1ee42a4e934830
2019-05-29 17:30:27 +08:00
zhiru
31a00449a4 MS-26 cmake. Add thirdparty packages
Former-commit-id: a68611c035820a429ae5ef1ae104a9826838dcca
2019-05-29 16:14:15 +08:00
yu yunfeng
4116f710f5 merge branch from Xu and add metrics
Former-commit-id: a5d3e97dbd87c6478ece637046a2d9545fbc973f
2019-05-28 18:46:07 +08:00
yu yunfeng
80db8aaf20 Fix compile error
Former-commit-id: 07f4dd06011ef519e29744dcd5b8ac9e407b2505
2019-05-28 17:50:20 +08:00
yu yunfeng
815bf5550f add metrics_unitest
Former-commit-id: 783161b2f8a70b24b605f2040f9381f4aa0fff07
2019-05-28 15:33:42 +08:00
Xu Peng
c5501202ad refactor(db): whole db api refactor
Former-commit-id: 3519e8a464bcd66b6da8ef2c579c08eaf13d17bd
2019-05-28 13:49:59 +08:00
yu yunfeng
1563f81ac2 add metrics
Former-commit-id: 3e811d555cf69eb2c8f515ada44c8df43e460de0
2019-05-28 13:34:47 +08:00
Xu Peng
ca33fbbe14 refactor(db): DropAll -Count CleanUp CleanUpFilesWithTTL
Former-commit-id: b718bb89945651de19a1263eaf64eab22d11eb6c
2019-05-28 11:04:37 +08:00
Xu Peng
874eeb8f7a refactor(db): FilesToIndex
Former-commit-id: fe5bd8ca372d0a4d5bf257f3f10853179d2356ce
2019-05-28 11:04:37 +08:00
Xu Peng
7fe5346f14 refactor(db): Archive
Former-commit-id: 21f153c1a57ad4bb706f6b177a10d45faf88ed99
2019-05-28 11:04:37 +08:00
Xu Peng
2789234931 refactor(db): FilesToMerge
Former-commit-id: 9101dcd75943bc241094af92156805090bf8e408
2019-05-28 11:04:37 +08:00
Xu Peng
09fdd0f849 refactor(db): FilesToSearch
Former-commit-id: dcb7f972ee13a0916129dfec5b05dad66025dfbf
2019-05-28 11:04:37 +08:00
Xu Peng
ec4e83db3f refactor(db): UpdateTableFile
Former-commit-id: e5b29fa1396d5a06c26a4917e15fed0082bbc7ae
2019-05-28 11:04:37 +08:00
Xu Peng
ba8929e9a4 refactor(db): GetTableFile
Former-commit-id: 9b5f8d3a6c3202acc5b16f9b75f4ebe9cb2c6c50
2019-05-28 11:04:37 +08:00
Xu Peng
fbe1278a3a refactor(db): DropPartitionsByDates
Former-commit-id: 2534fa34f690ba60788e3619b6a87a9a7ed8650e
2019-05-28 11:04:37 +08:00
Xu Peng
01e4e605e2 refactor(db): CreateTableFile
Former-commit-id: c29b8ccc97cc327ec9c278f2ea5456369365c4f3
2019-05-28 11:04:37 +08:00
Xu Peng
624e34f10d refactor(db): refactor DescribeTable
Former-commit-id: 021d731f3be6f338423caabef59bdd4c46ed02d8
2019-05-28 11:04:37 +08:00
Xu Peng
3d330e0aa4 refactor(db): change group_info to table_schema and add_group to CreateTable
Former-commit-id: e8d48ec8e54429bf5d1080997ca329b42ddcab82
2019-05-28 11:04:37 +08:00
Xu Peng
f2bb20c90d refactor(db): change group_id to table_id
Former-commit-id: bf0cec2552fcad95bf1b77cdfbdd423984e6f18f
2019-05-28 11:04:37 +08:00
Xu Peng
209d0e4806 refactor(db): change groupfilesschema to table*
Former-commit-id: e786234155eecb9d22ad2b6a8b2c9357675e5de4
2019-05-28 11:03:45 +08:00
Xu Peng
e94499cdff refactor(db): change groupschema and groupfileschema to table*
Former-commit-id: fbc69151149faa8ed32547bcdd1a9935dac34070
2019-05-28 11:03:45 +08:00
yu yunfeng
8510104066 fix conflict
Former-commit-id: cffe275e0430a89b99c17574766dff7c972d810d
2019-05-28 10:02:20 +08:00
yu yunfeng
1392e0d5c7 c
Former-commit-id: 420c70f051d7cbd2f9a0a5c4d8181ba11bb93f27
2019-05-27 16:31:20 +08:00
Xu Peng
c5b931d59e test(db): fix test error after impl exception
Former-commit-id: 71184ffe49ac0130d2002aef4f8f55c825414d0c
2019-05-27 14:59:00 +08:00
Xu Peng
7337cef31c Merge branch 'release-v1.1' into impl_simple_delete
Former-commit-id: 10d74a865946328366a49fb389d0038858064e83
2019-05-26 17:37:52 +08:00
Xu Peng
1c6a012b46 Merge branch 'branch-1.2' of http://192.168.1.105:6060/megasearch/vecwise_engine into release-v1.1
Former-commit-id: 56c25fba480cf53fed8e03f820a597dfd8138436
2019-05-26 17:34:32 +08:00
Xu Peng
74e6ef4a9c test(db): fix for ARHIVE_DISK_CHECK
Former-commit-id: 1a82a410db91e2b6f9ddc38bafc491a1204c0dd1
2019-05-26 16:51:30 +08:00
jinhai
8d3ad6aeae MS-4 Refactor the code structure
Former-commit-id: ab2c7af5968b367ca27bac2d991b0dae5ad2dc75
2019-05-26 14:46:38 +08:00
Xu Peng
92da0fa4ca refactor(db): for schema changes
Former-commit-id: 3d1aa65da396177ff49e1922ae032cec834f7850
2019-05-26 13:02:22 +08:00
Xu Peng
e09240e45f test(db): refactor with meta consts
Former-commit-id: a611af0886bdeb51b4a38da2e80b84a4fd13d0cc
2019-05-26 12:26:23 +08:00
Xu Peng
f9889598d7 test(db): check size
Former-commit-id: 115707db134408a52f14e95d25c5d434c05d1c9f
2019-05-26 11:27:31 +08:00
Xu Peng
3f28d33b6e test(db): add test for overall archive
Former-commit-id: 34b7aa89adc45c2505619b902e7701ce7df4e91a
2019-05-26 11:27:31 +08:00
Xu Peng
80860535a7 test(db): add test for archive days
Former-commit-id: 10dcbdf0d3f32fd90904150c294cbe87a0ebfa7b
2019-05-26 11:27:31 +08:00
Xu Peng
4c44b02b5e test(db): add archive test
Former-commit-id: 7fc4969944759203524c0dbac8fc4421fd528f28
2019-05-26 11:27:31 +08:00
Xu Peng
73fb498ff7 feat(db): add Archive conf in options
Former-commit-id: caa950e7119264fd911f21cd10b4fbb2db896b7d
2019-05-26 11:27:31 +08:00
Xu Peng
a7c22f8e53 test(db): test delete group partitions
Former-commit-id: af392c6bf9440a5d29ee152e4d4129153b499f94
2019-05-26 11:27:31 +08:00
Xu Peng
4eea03af5c feat(db): add simple delete partitions
Former-commit-id: ed39bb26d68f4ea576e824c081e72bfb17d15b8a
2019-05-26 11:27:31 +08:00
yhmo
011be04411 Merge branch 'jinhai' into 'release-v1'
# Conflicts:
#   cpp/src/utils/Error.h

Former-commit-id: 18470ad3970bec55315d738a006355c1ce2c1f4c
2019-05-15 16:40:00 +08:00
yangwei.yao
74d5802ba4 unit test
Former-commit-id: 3806f1d475b2dd1259fe48a013f01389f8975e5c
2019-05-15 15:01:07 +08:00
yangwei.yao
35eeae6f08 license check is vaild
Former-commit-id: 7381ad310d5b554c99f1f19f7fc460b33c36659f
2019-05-15 15:01:07 +08:00
yangwei.yao
384b9b8af2 1
Former-commit-id: 3642cd8f4089038eade6857854d1d1b42c5eceb8
2019-05-15 11:26:56 +08:00
jinhai
7c512bf752 Update on license check
Former-commit-id: ef039b5663e0a68c1dfdea7244de4d2e7e16c10e
2019-05-15 11:26:56 +08:00
yangwei.yao
128bc2b420 Refactor
Former-commit-id: 5c57d9054cae1e468a5795b928ecab4d18c1d4af
2019-05-15 11:26:56 +08:00
jinhai
06dd990b18 Refactor code
Former-commit-id: 31caf05ec1b75d9cd1de476104cdc0abf62acedd
2019-05-15 11:26:56 +08:00
yangwei.yao
5eb854b1b6 license_run
Former-commit-id: dbfbeafc516f45c89cf2b693f40ac19abf903df3
2019-05-15 11:24:37 +08:00
yangwei.yao
c7ba2112bb 05.11
Former-commit-id: 22e7d5214db47ac228d50989b01e3a5e71a719d4
2019-05-15 11:24:37 +08:00
groot
678f1010a1 use rocksdb column family
Former-commit-id: dbf59149386a71807ff3ea4498240afd102b5001
2019-05-14 11:16:18 +08:00
groot
56291b218d use rocksdb column family
Former-commit-id: 8cbc5d91e02e6bbc0eff1e329b4c76687d2c1f74
2019-05-13 15:17:05 +08:00
xj.lin
364af3b1a8 redefine default index build type
Former-commit-id: 1f10a7774b80b596323882bb74a46484a917344f
2019-05-11 11:27:06 +08:00
xj.lin
876f6a4c66 1 Support Cpu-version
2 Update build.sh support both cpu-build and gpu-build


Former-commit-id: 3c0ddd7fb2f93ab45b6f9878b71b6541617f92c4
2019-05-11 11:27:06 +08:00
Xu Peng
2a8c45d394 test(db): check add vectors result size
Former-commit-id: d72021ae7c0fc69c840780d023d6a7573b618ce5
2019-05-11 11:19:21 +08:00
jinhai
77f86fdeee License tests success
Former-commit-id: e10d0146a51286664bb01f5d55f694e547a8f597
2019-05-08 17:38:37 +08:00
yangwei.yao
414cbf860f Update CMakeLists.txt
Former-commit-id: 6007ad4c75ca615d6d21236a2ea5affe347672d1
2019-05-08 17:01:11 +08:00
Xu Peng
4428d56670 refactor(db): trait for engine and dbimpl
Former-commit-id: c42d9f4d7168b4d8e374ddb5ed0499ea1394a306
2019-05-08 12:13:01 +08:00
Xu Peng
9adc7bdf82 env(unittest): add missing lib
Former-commit-id: 3d923d0a8588226084f6935b184798f2a402849c
2019-05-08 11:05:09 +08:00
Xu Peng
0fb7334220 test(db): enhancement for unit test
Former-commit-id: 2fdacaf3f80a70c3319d9dc7b2756f042b5b5106
2019-05-07 09:44:35 +08:00
Xu Peng
b8949ca86f fix(env): fix compile error
Former-commit-id: 63a2957e3c226bdb08658d96738d30dc98a73619
2019-05-06 20:52:02 +08:00
xj.lin
2ac87c1e47 1. support IDMap
2. fix some bug
3. background job from IDMap -> IVF


Former-commit-id: ba8f24f09c5481103ad3f4c1c91d4deb70f26dad
2019-05-06 10:24:07 +08:00
xj.lin
56bbe40faf 1. fix operand serialize bug
2. support gpu-build
3. add unittest


Former-commit-id: bb36dcb05220d8f0648f282c7e38fe20f4ab3c16
2019-05-06 09:53:59 +08:00
Xu Peng
ce54690910 test(db): small change
Former-commit-id: 8cf0fe13bfd7715a491f00cc24e2efa37fd8decd
2019-04-30 14:17:24 +08:00
Xu Peng
21a98c0e02 test(db): refactor db test
Former-commit-id: c85ed1e09b51f9c883426f7c77da3261232f0745
2019-04-29 20:22:24 +08:00
Xu Peng
61854a6c23 test(db): refactor SetUp
Former-commit-id: dfbb0f819705c0fca4b5e0a7fb37ce7bc52761d6
2019-04-29 19:05:48 +08:00
Xu Peng
ed9dc51f27 test(db): samll change
Former-commit-id: 1bdf8515f7914a43e965334db36d253fea12abb7
2019-04-29 19:01:18 +08:00
Xu Peng
e78481f5e4 test(db): add meta files test
Former-commit-id: bd7b5371b11ddd769b178fe0e263b5759398e0d3
2019-04-29 18:10:30 +08:00
Xu Peng
f7853fcd20 test(db): add group file test
Former-commit-id: 8fa440c2be5f525388d45fca7e92244718e8c2fc
2019-04-29 18:10:30 +08:00
groot
bd9c14a871 typo
Former-commit-id: 89e00f1b579a2f78737efcafc04507f0f31049b1
2019-04-29 16:20:21 +08:00
groot
16df78caee add attribute for vector
Former-commit-id: e520d4e7aaceb1fedae62cc67326a550666efc6b
2019-04-29 16:14:21 +08:00
Xu Peng
c26629756a test(db): impl more group test
Former-commit-id: 5de1604a22951a2e96253f994d6af95ccd8bf019
2019-04-29 15:56:07 +08:00
Xu Peng
9ff65dc76c test(db): group test more
Former-commit-id: 31949c0387e3400c63d7387664dc8e142ce1ce17
2019-04-29 15:50:52 +08:00
Xu Peng
4b18d9fec1 test(db): add more meta test
Former-commit-id: b8078e972d1c08b38cd6ff272ec2cd6ab1d895b2
2019-04-29 15:47:09 +08:00
Xu Peng
4a66580f4f test(db): add meta test
Former-commit-id: 9668abe43a31a04c58311c12834fe5b89da23c07
2019-04-29 15:29:28 +08:00
Xu Peng
3dfdfef07a test(db): add utils in db test
Former-commit-id: 0e65a0a885cc3ead0fb233bd041bb4f8b8645898
2019-04-29 13:17:19 +08:00
Xu Peng
096c4639b7 refactor(db): remove dummy includes
Former-commit-id: b25398a114a59e79b0e20fca60843aecdbec51b5
2019-04-29 12:38:27 +08:00
groot
1aefac8ae0 fix unitest load config error
Former-commit-id: 8bf7417881a421bf5c28a31474743484e8fea155
2019-04-29 12:31:48 +08:00
groot
688a9992be fix make error
Former-commit-id: 7a5d078a48a92b0595e67bf8fe9891a075044bf4
2019-04-29 12:04:56 +08:00
groot
4cbdb58718 redefine thrift api
Former-commit-id: ed64f6205c2723111f3bc2771836a265b2474817
2019-04-29 11:09:57 +08:00
Xu Peng
2ff4cae2cf test(db): change test
Former-commit-id: e1922a567069b4c058acad186b8186b4cbbe0f4a
2019-04-28 21:01:30 +08:00
groot
d6dc77ced2 fix cmake warning
Former-commit-id: a3c4cb47f43d54e44f8a6b7f887e61f2182d998a
2019-04-28 20:51:21 +08:00
Xu Peng
f7cd398c3b test(db): change test case
Former-commit-id: 4d371cf9f3cb591eafff64373aaaabaabd90118c
2019-04-28 18:44:25 +08:00
Xu Peng
8c01725ff7 test(db): add more friendly timing print for test
Former-commit-id: 2a87319062a6f753881efd898517ac67fd4d3216
2019-04-28 18:44:25 +08:00
groot
9f35b62289 fix cache manager bug
Former-commit-id: d1b7f43865f6e0a059081531e1549a975c86d4aa
2019-04-26 19:45:26 +08:00
Xu Peng
7e00f351e1 test(db): change log format for unittest
Former-commit-id: a364d3800fbefbd9287df906b5e69f4ec89d1aa7
2019-04-26 17:59:51 +08:00
Xu Peng
b9af8670db test(db): update test
Former-commit-id: f3bf72ecd3c482d9a270342009f13be5263f89ca
2019-04-24 20:12:26 +08:00
xj.lin
ce7bc10f8c fix search
Former-commit-id: 14a6408d66811f1d1a1d5bb1cbbddbecb5dd4d51
2019-04-24 18:19:29 +08:00
groot
d6044cfc32 fix build error
Former-commit-id: d06ecbf29ddd4b70bfd056341c6537c66f9dbb55
2019-04-24 15:16:32 +08:00
groot
97d4738bc6 rewrite cache code
Former-commit-id: 00247bcda3df3d0e29bc4a809f7894ce92470e0e
2019-04-24 11:52:13 +08:00
Xu Peng
06ab815c7b feat(db): add count api
Former-commit-id: 9fb2b765a48d1753ba31a68e7b9b207273adb199
2019-04-24 10:28:05 +08:00
groot
4ce28a1e21 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 6ef6cb1953310c4e01b1787e1a041c25f7dfd951
2019-04-24 10:25:11 +08:00
groot
dc3e4f58a8 rewrite cache code
Former-commit-id: 8e76ab5219eedd24563ece59f70dec8a4464c44d
2019-04-24 10:25:00 +08:00
Xu Peng
af39787c92 feat(test): add unit test
Former-commit-id: 614f9c9b275b1893f212b0de966e069264fd13cc
2019-04-23 20:55:15 +08:00
groot
0bcb727b46 Merge branch 'jinhai' of 192.168.1.105:jinhai/vecwise_engine into jinhai
Former-commit-id: 086d172e4c9ba7db6a271940f2baa6ab5ede6069
2019-04-23 16:34:56 +08:00
groot
f642a7b38e redefine id mapper interface
Former-commit-id: 6fa296aa09aae1019ed1e49a481c3a1e34440071
2019-04-23 16:34:43 +08:00
xj.lin
db32c300e8 feat: add search support
Former-commit-id: 0bb20ad7b80ca432b83154efd59cb89e7cc2867c
2019-04-23 11:58:43 +08:00
groot
82fe888083 add unittest
Former-commit-id: 9c22540ce32d94d7f17626edb985d9c00af8fdec
2019-04-23 11:21:14 +08:00
groot
3f7fe2548a add id mapper
Former-commit-id: 56cfee9e3beeb474e2a56c3e3a3fdda111cfabb2
2019-04-23 10:10:20 +08:00
groot
8909b19722 add id mapper class
Former-commit-id: 6d9b05faca8200417e68de306abe2f1a35b601ff
2019-04-22 17:50:52 +08:00
groot
e9b7063402 add id mapper class
Former-commit-id: b12be12ea33f4b3f99a4f65b1156d7a86007dcc1
2019-04-22 17:27:03 +08:00
groot
41220cb25d add db unittest
Former-commit-id: 5a9e4a10ada30d19fee14b1d2e1d4123ac6dee04
2019-04-21 17:01:02 +08:00
groot
0b545a70d8 change build settings
Former-commit-id: fe3df7b281a528d4e07669c7c4e0e1521eb6bf2a
2019-04-21 16:19:04 +08:00
groot
2b035e54a6 index search unittest
Former-commit-id: 9632c0668ce71d07bba6f13e9ee46df4e1af6b38
2019-04-21 15:55:48 +08:00
xj.lin
d7c7720ef6 update cmakefile
Former-commit-id: 2827b60ab09f52a244a6da690c42340884a48f39
2019-04-19 16:43:30 +08:00
xj.lin
cc641236d2 add TopK
Former-commit-id: 847a46e3b7ab8bead610ec9888fce5a4279a6920
2019-04-19 16:07:45 +08:00
xj.lin
3fd083c987 add wrapper and unittest file
Former-commit-id: 9b115de1c9d84ed4c790980793fec28169ca7837
2019-04-16 11:05:38 +08:00
jinhai
987ff82e10 Add log support and tests
Former-commit-id: f946b994174633082110e8d5b26640998e4ed35e
2019-04-14 19:46:25 +08:00
groot
dafd5a45cd add cache classes
Former-commit-id: 9bbc325ab6b6a1916801c05e3eb08e356db38299
2019-04-14 16:35:46 +08:00
groot
07b272f058 add cache classes
Former-commit-id: a92eb3ea2a350d6bfd1bf13e2d9c21d29c8205c5
2019-04-14 16:35:46 +08:00
jinhai
0c4f1cef5d Update Unit test samples
Former-commit-id: 7f6a6f38fa33330bbb3d3aac534ee7297f45d824
2019-04-14 10:25:49 +08:00
jinhai
03d5d3f2c0 Add conf to CMakeLists.txt
Former-commit-id: 06d485991e06efb84e54e7ba6bbd0ae650442a59
2019-04-14 10:23:10 +08:00
jinhai
a11a00a8ba Add gtest
Former-commit-id: 6d5fbda28e6e1fabbd4a9d91691a652f38497597
2019-04-14 09:46:12 +08:00
jinhai
7476d89836 Update gtest
Former-commit-id: f36a47dd6fb651b6552fa87cb9ec09ac8839990a
2019-04-12 21:16:56 +08:00
jinhai
1a1ba0434b Add cpp source code
Former-commit-id: d2df17911de6634f70dfa812211d0a6f52aadb18
2019-04-12 20:58:45 +08:00