907 Commits

Author	SHA1	Message	Date
John Wang	6eee7cb42c	feat: fix azure embedding Too many inputs problem (#530)	2023-07-07 11:17:36 +08:00
John Wang	b9b0866a46	fix: generate summary error when tokens=4097 (#488)	2023-06-29 12:54:50 +08:00
John Wang	df68a7c82b	feat: Optimize the quality of the title generate (#484)	2023-06-28 19:59:20 +08:00
John Wang	9d98669e7d	fix: dataset destination error (#477)	2023-06-28 15:51:07 +08:00
John Wang	408fbb0c70	fix: title, summary, suggested questions generate (#476)	2023-06-28 15:43:33 +08:00
crazywoola	998f819b04	use sub to operate all (#475)	2023-06-28 14:58:40 +08:00
Jyong	334f46d0b6	Fix/json format (#466)	2023-06-28 13:58:50 +08:00
Jyong	2eea114ac0	fix special code (#473)	2023-06-28 13:58:36 +08:00
Jyong	c67ecff3fe	Fix/json format (#465)	2023-06-27 17:15:03 +08:00
John Wang	d5b42c09ee	fix: template parse error when history include {{any}} (#463)	2023-06-27 16:35:50 +08:00
John Wang	835bf9fd8d	fix: template parse error when pre prompt include {{}} (#462)	2023-06-27 15:51:55 +08:00
John Wang	c720f831af	feat: optimize template parse (#460)	2023-06-27 15:30:38 +08:00
John Wang	df5763be37	feat: optimize openai error raise (#459)	2023-06-27 12:34:47 +08:00
John Wang	cad1532f7c	feat: optimize index_struct copy (#442)	2023-06-25 17:52:22 +08:00
John Wang	951afcaaed	feat: optimize weaviate error msg (#441)	2023-06-25 17:05:56 +08:00
John Wang	3241e4015b	feat: upgrade langchain (#430) ... Co-authored-by: jyong <718720800@qq.com>	2023-06-25 16:49:14 +08:00
lisaifei@cvte.com	23ef2262bd	fix: filter empty value in xlsx to improve vector similarity hit (#422)	2023-06-21 11:25:52 +08:00
Jyong	36dc05c4da	fix chinese encoding (#411)	2023-06-19 18:41:17 +08:00
Jyong	226f28edcb	Feature/self host notion import (#397)	2023-06-17 19:50:21 +08:00
Jyong	9253f72dea	Feat/dataset notion import (#392) ... Co-authored-by: StyleZhang <jasonapring2015@outlook.com> Co-authored-by: JzoNg <jzongcode@gmail.com>	2023-06-16 21:47:51 +08:00
John Wang	184afa69ff	feat: add gpt-3.5-turbo-16k support and update openai gpt-3.5-turbo & Embedding Ada v2 unit price (#358)	2023-06-14 12:17:43 +08:00
John Wang	ab115b5f87	fix: completion stop invalid (#355)	2023-06-13 17:47:42 +08:00
John Wang	a11f36ca60	fix: stop completion response not save to db (#351)	2023-06-13 15:47:58 +08:00
John Wang	cd136fb293	feat: add WEAVIATE_BATCH_SIZE (#349)	2023-06-13 14:49:40 +08:00
John Wang	6a3ab36101	feat: optimize weaviate batch size (#348)	2023-06-13 11:28:15 +08:00
Jyong	3d14431b96	Fix/excel data format (#334)	2023-06-09 20:21:11 +08:00
lisaifei@cvte.com	0abd67288b	feat: support xlsx file parsing (#304) ... Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>	2023-06-09 15:57:19 +08:00
Jyong	2bf48514bc	fix markdown parser (#230)	2023-06-06 19:51:40 +08:00
John Wang	a3ee037d6d	feat: optimize output parse failed error (#298)	2023-06-05 11:23:51 +08:00
John Wang	490858a4d5	feat: auto rule generator (#273)	2023-05-31 22:03:15 +08:00
John Wang	44a1aa5e44	fix: dataset_tool npe (#274)	2023-05-31 17:16:27 +08:00
John Wang	75f7a96025	feat: ignore validate failed error log (#256)	2023-05-30 12:25:42 +08:00
John Wang	5ca88a4fd9	fix: raw json parse in llm router chain (#254)	2023-05-30 12:16:45 +08:00
John Wang	bb7f454ecd	fix: dataset desc npe (#246)	2023-05-29 19:56:36 +08:00
John Wang	7f48fadd41	fix: prompt template parantheses select error (#244)	2023-05-29 19:10:31 +08:00
John Wang	af2138e8b8	fix: json parse in router chain output (#243)	2023-05-29 18:25:01 +08:00
John Wang	88545184be	feat: support multi datasets router chain mode (#231)	2023-05-28 22:44:54 +08:00
John Wang	2c23caacd4	fix: introduction key error (#221)	2023-05-26 20:49:38 +08:00
John Wang	1a5acf43aa	Fix/shared lock (#210)	2023-05-25 21:31:11 +08:00
John Wang	d93365d429	fix: azure embedding not support batch (#188)	2023-05-24 18:55:07 +08:00
John Wang	4350bb9a00	Fix/human in answer (#174)	2023-05-23 19:54:04 +08:00
John Wang	056898bf21	fix: quota update error on azure openai (#172)	2023-05-23 16:16:22 +08:00
John Wang	6da5e54180	Feat/open azure validate (#163)	2023-05-23 14:16:26 +08:00
John Wang	f3219ff107	fix: template string in template error (#162)	2023-05-23 13:16:33 +08:00
John Wang	219011b62a	fix: disable template string in query (#160)	2023-05-23 12:57:26 +08:00
John Wang	90150a6ca9	Feat/optimize chat prompt (#158)	2023-05-23 12:26:28 +08:00
John Wang	9a5ae9f51f	Feat: optimize error desc (#152)	2023-05-22 17:39:28 +08:00
John Wang	54a6571462	fix: extra input for opening statement was not suitable for prompt (#143)	2023-05-22 14:32:22 +08:00
John Wang	b42cd38cc9	fix: internal error when user is none in service api call (#129)	2023-05-21 17:29:47 +08:00
John Wang	e8e8f9e97d	Fix: move pre prompt to user massasge in chat mode (#126)	2023-05-21 17:06:04 +08:00
John Wang	1b6e3ef964	Feat: optimize inner prompt (#121)	2023-05-21 11:29:10 +08:00
John Wang	8fc2663693	fix: weaviate batch insert timeout (#108)	2023-05-19 21:57:32 +08:00
John Wang	f68b05d5ec	Feat: support azure openai for temporary (#101)	2023-05-19 13:24:45 +08:00
John Wang	0587ff0fba	fix: remove empty segment in splitter (#68)	2023-05-17 15:02:58 +08:00
John Wang	815f794eef	feat: optimize split rule when use custom split segment identifier (#35)	2023-05-16 12:57:25 +08:00
John Wang	f5b2271c8c	fix: import wrong user (#32)	2023-05-15 23:30:58 +08:00
John Wang	db896255d6	Initial commit	2023-05-15 08:51:32 +08:00