Commit Graph

398 Commits

Author SHA1 Message Date
XuanYang-cn
ab7f642740
Add alias in paramtable (#5878)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-06-19 12:38:06 +08:00
xige-16
e4c51aae36
Add recovery logic for querynode and queryservice (#5843)
* merge milvus/recovery2

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add recovery logic in queryservice

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* debug smoke case

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add etcd to querynode

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix release partition error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix load balance error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* debug querynode down and recovery

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add log

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix showCollection

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* skip smoke test search without insert

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-19 11:45:09 +08:00
sunby
33f5225968
Use physical channel to init msg stream (#5815)
* Use physical channel to init msg stream

Signed-off-by: sunby <bingyi.sun@zilliz.com>

* fix search collection error check (#1)

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: bigsheeper <954206947@qq.com>
2021-06-18 16:02:05 +08:00
bigsheeper
46151d203f
Fix tSafe cannot update correctly (#5820)
* Fix tSafe cannot update correctly

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* skip test_load_partitions_release_collection

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* skip test_release_collection_during_searching

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-17 16:56:04 +08:00
yukun
e9a8d1c404
Add vChannels in proxy for query results (#5802)
* Fix proxynode for new retrieve logic

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove querynodenum from proxynode and querynode

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove QueryNodeIDList from proxy

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-16 20:15:59 +08:00
bigsheeper
d6f7fbf19f
release collection synchronously (#5798)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-16 15:31:57 +08:00
bigsheeper
bf39644457
Fix channels in query node and fix search (#5795)
* fix add channel error

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix tSafe vChannel key

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-16 12:05:56 +08:00
xige-16
97049ce293
use dataservice's getRecoveryInfo to get load and watch info (#5790)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-16 11:09:56 +08:00
yukun
5c18138a6b
Fix retrieve_collection return nil vchannel (#5787)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-15 20:07:30 +08:00
bigsheeper
58bf92a407
Add vChannel,pChannel in query node and get vChannel from master in query service (#5784)
* add vChannel,pChannel in query node and get vChannel from master in query service

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-15 20:06:10 +08:00
yukun
fceba63a33 Add segment and channel msgs in retrieve results (#5750)
* Fix query hang bug (#5709)

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add segment and channel msgs in retrieve results

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-15 16:38:59 +08:00
zhenshan.cao
5c69c6902d Refactor proxy channelTimeTick and fix search timeout (#5760)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:36 +08:00
Cai Yudong
0f4bd50ce3 Support ETCD endpoints array (#5755) 2021-06-15 16:36:36 +08:00
zhenshan.cao
33a43f48c8 [skip ci] Fix bug: Search timeout and refactor client init logic (#5735)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:24:48 +08:00
xige-16
f2e551e9a0 Add asConsumer before seek (#5706)
* add asConsumer before seek

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* get dmChannel from master

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* use pChannel instead in queryservice

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-15 16:14:27 +08:00
FluorineDog
bec9f2c182
Split segcore and plan proto for future feature (#5767)
* Split segcore and plan proto for future feature

Signed-off-by: fluorinedog <fluorinedog@gmail.com>

* lint

Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-15 14:43:57 +08:00
bigsheeper
cdbc6d2c94
Refactor query node and query service (#5751)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-15 12:41:40 +08:00
yukun
e97936ba1c
Fix query hang bug (#5709)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-10 14:33:49 +08:00
bigsheeper
8aae0f7cc9
Refactor flow graph and load/watchDML in query node (#5682)
* Refactor flow graph and load/watchDML in query node

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-09 11:37:55 +08:00
zhenshan.cao
bc46e4780d
Fixbug:index is not loaded in some cases (#5633)
* Fixbug:index is not created in some cases

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Delete unecessary print

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* fix create index

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-06 09:41:35 +08:00
zhenshan.cao
7dac20c35c
Add log for poxynode transform data and querynode segment insert (#5627)
* Add log for poxynode transform data and querynode segment insert

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Decrease print times

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-05 16:21:36 +08:00
zhenshan.cao
03e3b4beb4
Add log to startup process (#5594)
* Add log to startup process

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fixbug: avoid ctx exceed deadline

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fmt code

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fix bug: wrong time unit

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fixbug: datanservice client reconnect use time ctx

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-04 16:29:35 +08:00
FluorineDog
9a90313390
Support GetEntityByIDs in CGo, fix segcore bugs (#5563)
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-06-04 10:38:34 +08:00
Xiangyu Wang
e80f06c030
Add retrieve process log (#5561)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-03 20:56:33 +08:00
Xiangyu Wang
f791ccb246 Update OWNERS file
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-03 20:01:24 +08:00
yukun
57ece4a771
Fix retrieve_collection bugs (#5575)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-03 19:41:33 +08:00
zhenshan.cao
b0b8f58192
Fix bug: search timeout (#5557)
* Fix bug: search timeout

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Add log and fix unittest bug

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-03 14:58:34 +08:00
yukun
dcb4161c9f
Fix retrieve_service (#5531)
* Fix retrieve_service

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix retrieve_collection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-02 19:18:33 +08:00
yukun
48f35ffa97
Add publishRetrieveResult (#5501)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-31 18:08:32 +08:00
Xiangyu Wang
ca0993c274 Update OWNERS
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
Cai Yudong
b414800d49
Update Seek interface (#5492)
* update Seek

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update Seek for mqTtMsgStream

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* use Retry in Seek

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-29 23:21:34 +08:00
yukun
cd549f812d
Add retrieve_service (#5481)
* Add retrieve_service

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix for tSafeReplica

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-05-29 11:16:29 +08:00
bigsheeper
03f90ff28c
refactor collection replica and add tsafe replica in querynode (#5475)
* refactor collection replica and add tsafe replica in querynode

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* static check2

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* code format

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 15:40:32 +08:00
xige-16
fce792b8bf
Add historical and streaming module in querynode (#5469)
* add historical and streaming

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix GetSegmentInfo

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* pass regression test

Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2021-05-28 10:26:30 +08:00
neza2017
f80dbab6ec
watch proxynode (#5424)
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Resolves: #5423
2021-05-26 12:14:30 +00:00
neza2017
c28c34e852
let master use session.ServerID as nodeID (#5385)
let master use session.ServerID as nodeID

also see #5386 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-25 07:06:05 +00:00
zhenshan.cao
3e73775cc1
Add ComputeProduceChannelIndexes for msgstream (#5364)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-05-24 08:30:09 +00:00
neza2017
e326eaad1e
master client,reconnect if grpc failed (#5360)
master client,reconnect if grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-24 01:44:49 +00:00
godchen
0eee7e5252
Change session (#5329)
Change session.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-21 11:28:52 +00:00
sunby
c1efa53779
Remove redundant fields in SegmentInfo and related structure (#5280)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 06:51:25 +00:00
Xiangyu Wang
23c4de0eb8
Flush statistics for all int64 fields (#5318)
Resolves: #5262

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-20 10:38:45 +00:00
godchen
e224d1e725
Add SessionManager (#5288)
Add SessionManager.
Resolves: #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-19 10:36:05 +00:00
godchen
b74afd7a0e
Add service registration (#5189)
Add service registration.
Part of Issue #5174.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-14 02:05:18 +00:00
dragondriver
b7977698a8
Change the codec style of expr plan from text to binary (#5129)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 11:27:17 +00:00
dragondriver
e5d4963ba0
Distinguish the dsl and expr in proxy and query node (#5118)
Pass a parameter `IsExpr` from proxy to query node, so query 
node can create search plan according to the variable `IsExpr`.
It makes `segcore` unnecessary to distinguish `dsl` or `expr`
using dynamic exception. When `IsExpr` is set to true, query
node will call `CreatePlanByExpr` according to the passed
information about expression. Otherwise query node will keep
still to use `CreatePlan` according to the `dsl` information. At
the same time, this pr adds some unittests to `CreatePlanByExpr`,
these unittests translate already exist case with `dsl` to case with
`expr`.

Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-05-07 07:20:47 +00:00
FluorineDog
88f5642603
Add plan proto and support basic boolean expr parser (#5088)
**What type of PR is this?**
- [x] Feature

**What this PR does / why we need it:**
This PR supports boolean expression as DSL.
1. The goal of this PR is to support predicates
    like `A > 3 && not B < 5 or C in [1, 2, 3]`. 
2. Defines `plan.proto`, as Intermediate Representation (IR) 
    used between go and cpp. 
3. Support expr parser, convert predicate expr to IR
    in proxynode, while doing static check there
4. Support IR to AST in cpp, enable the execution
2021-04-29 08:48:06 +00:00
bigsheeper
88e1d651cb
Remove partition and segment ids properly in query node (#5090)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

**What type of PR is this?**

- [ ] API-change
- [x] BUG
- [ ] Improvement
- [ ] Documentation
- [ ] Feature
- [ ] Test and CI
- [ ] Code Refactoring

**Which issue(s) this PR fixes:**

Fixes #

**What this PR does / why we need it:**

Not Available
2021-04-29 07:59:08 +00:00
bigsheeper
4197b094bf
Use internal dsl and placeholder group (#5033)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-25 06:08:28 +00:00
bigsheeper
c4b379be8b
Set search graceful time from config (#5014)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-24 07:53:37 +00:00
bigsheeper
2b5bedf736
Use multiple search channels (#5018)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-24 02:44:28 +00:00
bigsheeper
00bb1014cd
Add search channels to query node (#5012)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-23 10:11:26 +00:00
bigsheeper
dadb02db75
Remove unused params in query node (#4987)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-23 10:07:45 +08:00
Xiangyu Wang
82ccd4cec0
Rename module (#4988)
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
sunby
fad94fb576
Remove unsed configs (#4990)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-22 03:04:59 +00:00
xige-16
1165db75f6 Optimize search performance
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-19 19:30:36 +08:00
bigsheeper
71b8f309b2 Add licence to query node and query service
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-19 13:47:10 +08:00
bigsheeper
08c5134286 Fix collection cannot be found when searching
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-16 17:37:50 +08:00
bigsheeper
9e7559b865 Make query node asynchronously load and release collection
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-16 14:40:33 +08:00
FluorineDog
ce7a5ea699 Support segcoreinit
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-04-16 14:02:49 +08:00
XuanYang-cn
e281f6a4a1 Remove useless configs in config files
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-13 10:04:39 +08:00
godchen
deba964590 Change name of kvBase
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-12 18:09:28 +08:00
bigsheeper
39458697c7 Use asynchronous functions of load and release
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-12 09:18:43 +08:00
xige-16
22eda19bc4 Fix mem leak when load index
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-10 10:10:53 +08:00
sunby
751c9d4e81 Refactor meta.go
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-09 09:55:04 +08:00
xige-16
332b14c915 Delete querynode’s redundant load IO
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-04-07 18:29:19 +08:00
bigsheeper
fe3fa8dd1d Fix search service unittest
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-04-01 15:39:23 -05:00
Xiangyu Wang
87a1e0b662 Reorganize msgstream
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-02 13:48:25 +08:00
xige-16
c10b36f188 fix getting wrong offset when segment preinsert
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-31 16:16:58 +08:00
xige-16
a6f1de036b Optimize search performance in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-30 22:16:58 +08:00
zhenshan.cao
efbf4452c5 Add log for port changed or proto unmarshal error
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-30 20:19:30 +08:00
godchen
8f58d5641b Perfect trace and add trace init
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-30 16:36:34 +08:00
Xiangyu Wang
8d66388b8c Add logs for querynode
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-03-30 15:00:14 +08:00
yukun
432b53149b Refactor msgstream
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-03-26 20:10:11 +08:00
bigsheeper
8a4c6a039f Add search log
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-25 18:09:47 -05:00
xige-16
7e60460aee close timeTickStream in flow graph when the collection is released
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-26 18:40:04 +08:00
bigsheeper
dfb68a7e46 Remove unused segment
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-25 16:08:08 -05:00
FluorineDog
f39dcdb8f3 Support error code in segcore
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-26 16:18:30 +08:00
neza2017
eca1e25470 Add msg id at master service
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-26 15:13:33 +08:00
bigsheeper
1e4afda824 Add mutex for query node map, search buffer and dataSyncService
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-24 15:40:59 -05:00
quicksilver
7ad9b36207 Update reviewdog/action-hadolint github action version to v1.16.1
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-25 14:41:46 +08:00
bigsheeper
350e0df5f7 Refactor search service
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-22 16:59:46 -05:00
bigsheeper
1634d75980 Release flowgraph properly
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-22 12:49:50 -05:00
xige-16
1a1e864709 Fix query node crash when empty search
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-22 19:20:56 +08:00
zhenshan.cao
c2734fa55f Fix bug and enchance system
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
groot
2280791128 Add memory message stream for search
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-03-19 20:16:04 +08:00
zhenshan.cao
636755827f Fix unittest bug: query node num
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-17 14:19:14 +08:00
FluorineDog
2cec04ed90 Fix empty schema proto hack
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-17 11:35:28 +08:00
xige-16
b92ad3edd6 Fix error when search on collection without partitions
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-15 19:58:52 +08:00
groot
47d9471498 Change gracefultime to 1 second
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-03-13 14:42:53 +08:00
xige-16
8a5c039137 Fix search error when running single node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-12 19:23:06 +08:00
godchen
f3649f0419 Refactor interface and proto
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
ThreadDao
ca916a5c47 Add ci nightly
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-11 14:14:29 +08:00
xige-16
d35d316056 Close seek function to pass regression test
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-11 10:21:24 +08:00
xige-16
09ae985daa Fix wrong error code in master_service_test.go
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
del-zhenwu
b1763c3690 Disable xdist in test cases
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-10 15:27:26 +08:00
XuanYang-cn
8567679888 Check enableIndex before load index
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-10 14:51:00 +08:00
neza2017
7b2d67242d Fix describe segment if index not exist
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-10 14:45:35 +08:00
quicksilver
455cc59dbb Update publish-test-images.yaml
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
sunby
76480fcefe Change default log output to stdout
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 16:24:55 +08:00
sunby
ab21115d54 Init rand.Seed
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 15:25:55 +08:00
ThreadDao
7a3223dc81 tags collection stats
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-08 10:09:48 +08:00
Xiangyu Wang
e5d595564a Add log for singlenode
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-03-05 18:16:50 +08:00
quicksilver
74154a11a4 Fix deploy error during regression stage
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-05 16:52:45 +08:00
sunby
ddddd65d10 Delete internal/errors package
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
bigsheeper
447a15207e Add zap log to query node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-05 09:21:35 +08:00
xige-16
6cdd4d02fc Refactor seek function
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-04 14:49:51 +08:00
ophunter233
4a921ffd7e Stop listen to dd channel in query node
Signed-off-by: ophunter233 <chengming.li@zilliz.com>
2021-03-03 16:06:02 +08:00
godchen
7b9fdd7f29 Add opentracing
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-26 17:44:24 +08:00
xige-16
50a5f97421 Delete componentStateResponse in queryService.proto
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-26 15:26:21 +08:00
cai.zhang
f5977a1302 Change retry times and add retry logic
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-26 15:17:47 +08:00
bigsheeper
9edbff0a6b Fix fields check
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-26 11:15:44 +08:00
Cai Yudong
84110d2684 Add tests/benchmark and tests/python_test using new python SDK
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-02-25 17:35:36 +08:00
bigsheeper
08a020798e Release collection and partitions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-24 17:24:51 +08:00
XuanYang-cn
fd562f9f9c Update doc: add proxy graph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-24 09:48:17 +08:00
xige-16
d5379a82a8 Fix load binlog error when segment not flushed
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-23 14:13:33 +08:00
zhenshan.cao
bbfcbbdd68 Fix ci: paramstable and startup logic refactor
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 11:40:30 +08:00
yukun
e786ad6aa8 Fix inconsistency of produce msg and consume msg with rmq
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-22 16:34:15 +08:00
sunby
b07a371f25 Create a goroutine to receive msg for every consumer
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-22 09:58:34 +08:00
xige-16
861576f77a Checkout field ids when load segment in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-22 10:44:38 +08:00
xige-16
f62078c027 Fix crash error when search
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-20 10:14:03 +08:00
xige-16
a6442cb600 Fix querynode memory leak
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-20 09:20:51 +08:00
sunby
5769c000a1 Find failed python tests and add skip mark "r0.3-test"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-19 15:37:04 +08:00
bigsheeper
d8f41db823 Fix search crash error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-19 13:56:01 +08:00
xige-16
450ea631bc Fix queryService assign queryChannel failure
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-18 16:26:02 +08:00
xige-16
70fe5233cf Watch queryChannel on query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-09 17:09:26 +08:00
groot
833f1d49ab Let singlenode use rocksmq
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-09 15:57:10 +08:00
zhenshan.cao
7901d98d5e Fix bug: return wrong IndexID 0
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-08 18:42:33 +08:00
groot
dc3736281a Integrate message stream
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-08 14:30:54 +08:00
bigsheeper
12b2eaf196 Rename apis
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-07 21:26:03 +08:00
zhenshan.cao
1ba8e2448f Add tsLoop for indexservice
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-07 18:38:58 +08:00
bigsheeper
a64c831ed9 Fix segment replacement bug
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-07 18:37:18 +08:00
bigsheeper
7342e0758c Fix index and flush errors, and fix master crash error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-07 17:02:13 +08:00
bigsheeper
b07b2484dc Fix error when loading
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-07 10:29:58 +08:00
xige-16
cdcf006690 Fix loadCollection error when query service assign insert channels and query nodes
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-07 09:30:48 +08:00
xige-16
a12b184e02 Add field schema to LoadCollection and LoadPartition photo
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-06 17:37:10 +08:00
bigsheeper
e685f1825b Fix unittest caused by param table
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-06 15:16:10 +08:00
groot
b034740c6c Make paramstable initialize once by using do_once
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-06 13:39:15 +08:00
bigsheeper
e9ee9a273e Refactor load service and check insertion binLog periodically
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-06 11:35:35 +08:00
sunby
0111cba8ae Fix startup bugs in some modules
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-06 10:28:53 +08:00
dragondriver
7e1887da12 Add start.sh and stop.sh, remove them later
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-05 14:31:40 +08:00
bigsheeper
a7eae3a4c1 Remove consumer in query node's initialization
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-05 14:15:10 +08:00
bigsheeper
1578c13224 Refactor collection replica
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-05 10:53:11 +08:00
bigsheeper
2ee54541aa Fix query node address
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-05 10:25:47 +08:00
godchen
c2ca2c276f Fix response check error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-04 19:34:35 +08:00
dragondriver
e0e8e1605e Implement the release-related task and load-related task in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-04 17:47:19 +08:00
sunby
7270d18c98 Fix timesync startup bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-04 17:31:02 +08:00
xige-16
aaac839075 Joint debug query service success with other components
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-04 17:09:18 +08:00
zhenshan.cao
b89e5a3240 Add GetQuerySegmentInfo
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-04 14:37:12 +08:00
sunby
71b6c88c6e Defer lock's unlock in meta::DropSegment
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-04 11:52:10 +08:00
Xiangyu Wang
8d35e76ad1 Change Msgstream interface
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-04 13:55:47 +08:00