arcadia
-
v0.1.0
Published by github-actions[bot] 10 months ago
arcadia-v0.1.0
Welcome to this new release! Our first release towards one-stop LLMOps!
Images built for this release:
kubeagi/arcadia:v0.1.0
kubeagi/data-processing:v0.1.0
Breaking Changes:
None
Feature summary ๐ ๐ ๐
- Dataset management
- Versioned dataset management with default datasource
ObjectStorageService
- Comprehensive data processing capabilities: data clean,QA split with LLM
- Object storage service by default
- RDMA as a optional storage serivce wihch is now used by Models
- AI Knowledgebase
- Auto QA Embedding generation and indexing
- Chromadb as the vector store by default
- AI Model Service
- Able to host llm and embedding models in kubernetes via our
Worker
protocol: qwen,baichuanvicuna,chatglm,bge-large-zh-v1.5,etc...
- Able to integrate with powerfule 3rd_party providers,like zhipuai,opeani,etc...
- Model loading accelerations with rdma network protocols
- LLM Applications
- A powerful and flexible Application Runtime
- Provide LLMChain and RetrivalQAChain for common LLM applications and RAG applications
- A all-in-one deployment helm chart
Changelog
New Features
- b1bda3cd5d819cfcd8bbc419bd61e30305602c56: feat: Develop CRD Datasource (@zqq454224016)
- 8de4d5a332f9eed9d9071a30cf6034b9af553338: feat: a kubeagi yaml file to install arcadia with kubebb (@bjwswang)
- 82a1f4333d13ca051ad56b62deca32a026f0ce1d: feat: able to configure base url for openai kind of embedders/llms (@bjwswang)
- 933416c241c1af55fc7fc42876c08b32fd9bf27f: feat: able to configure text splitter in local dataset management (@bjwswang)
- 5df65ad595e8f7d765b4a73440334daeeedf7cfc: feat: able to configure worker type when create and update (@bjwswang)
- 6ec48be377e65163f9b1c51e92e2ace2a37efc75: feat: able to get model list provided by Embedder and LLM (@bjwswang)
- 11131519eb397d89ffd9c83b07103552145c50da: feat: able to load multiple files into vector store with arctl (@bjwswang)
- 04f4d1a95b34ae8ceeb635a1655099db497062d9: feat: able to offline worker instead of remove (@bjwswang)
- 0fc7121460dd41fea4ff581cf60ef1ce5215b239: feat: able to user worker's llm/embedding service as 3rd party provider (@bjwswang)
- 295710b65282e32582f5f1afc66f82c8ae1aefc2: feat: able to view system pre-configured models (@bjwswang)
- 450f9897eb1d9ff0904a92c61dba82e47eb1184c: feat: add CRD Embeddings (@Lanture1064)
- 9a210ca4011930f3c52ff111cd78a9ea316fbccd: feat: add CRD LLM controller (@Lanture1064)
- 75e437a795e2ae5087c66d726d571a6438c8e963: feat: add CRD: KnowledgeBase and VectorStore (@Abirdcfly)
- 1823608d35fd611f6894fcf34e581df44f8cbd7e: feat: add CRDs for App (@Abirdcfly)
- d966c3666f8a1b858b51599e0929c07225f4e282: feat: add LLM read & list api (@Lanture1064)
- fccd8256aed6240368449f0db05679cdc8e66a35: feat: add Model.gql (@dayuy)
- 8ec9adc1994bd22401c0b2e48ad8c2011912b8df: feat: add RDMA definition to datasource (@0xff-dev)
- c2f8d75bed7486dd3316b2815c1e9d7498381b02: feat: add SDK to call the API (@)
- 73f20da08c916ed6096418d9ea4b1dfd1fd1dc20: feat: add SSE invoke support for API server sample (@Lanture1064)
- 51f1416ac4661a1a4d1e710e9b1bbebcf5c23979: feat: add a cli to load documents and chat with similarity search (@bjwswang)
- eb6100ae9dbf35ddfe17a29f2d2a9db7e3b8e7e9: feat: add a new intermediate status OfflineInProgress (@bjwswang)
- 64bd42b970b3d8bcac5a010e2077c963bbdcec90: feat: add auto graphql sdk generator action (@Abirdcfly)
- a04cf90d7d155efdad8d521362431d5542c47144: feat: add baichuan-7b chatglm-6b in dashscope as llm (@Abirdcfly)
- 04b90a67f696a8445c2cc756a3a31f704d3dbda2: feat: add beijing_gjj_bot example (@Abirdcfly)
- d2c5b52ada88aa6cd9d79906b77b2ff6a7c8c4cd: feat: add chart postgresql as arcadia dependency (@bjwswang)
- 9e90dea7616060cbf3a128ba25f964296c209b29: feat: add checkModelService API & fix (@Lanture1064)
- b148b4e17414ac5bb82b349b195ab7ced9d760a2: feat: add chromadb (@0xff-dev)
- 2a8dbcddec780a72bc702c6306c191775aed085a: feat: add dashscope as llm (@Abirdcfly)
- d4bdbd30100252c99369308e3eaaaa42510b4677: feat: add dataprocess helm chart (@Lanture1064)
- 5036518d39189a956c8864c1298c5dd7de9c878a: feat: add dataset.gql and versioned_dataset.gql (@dayuy)
- 9c30084f5df0e01fe6a6765d2a2e57687b844238: feat: add datasource comments and update fields (@zqq454224016)
- ac7c6199f8f9d7babaf5a8116add64ca855839b3: feat: add document Q&A chat API server example (@Lanture1064)
- 536db677d3ffdce0811a29b61f5fbb6cd225bec7: feat: add embedder API (@zqq454224016)
- 8af5ab78962c804531c517dfe0d81ac35cd6dbc1: feat: add embedder and knowledgebase gql (@zqq454224016)
- 9e6d4fbd2100502bf1c3b56abfe196ad1892a072: feat: add example for CRD Datasource test (@zqq454224016)
- 957057f7de7bf1286f0332e8c4de472599dcd351: feat: add fastchat API server & controller helm chart (@Lanture1064)
- 99f70c5fb87a73aa079c99218789ff67c9671680: feat: add internal url for endpoint (@bjwswang)
- bdf8a51d0ce87b9e283c216e4a92fe8d947dd022: feat: add knowledgebase API and update comments (@zqq454224016)
- 9fd129b495f3b738172c764ea24361d96b1822d1: feat: add knowledgebase application (@Abirdcfly)
- a821d924dcc83b46d880a65c6b7dcb96be2e7102: feat: add kubeenv for data processing and lint with isort (@bjwswang)
- 7261fb5dc12c26973d8b579c9b702cf1b5a603aa: feat: add llama2 in dashscope as llm (@Abirdcfly)
- f3b4b32502bedd68223bf6b66e098cacd670c295: feat: add llm_config in data process config (@bjwswang)
- 6e9895345279d6bfce735a8861dfd880f47bbb3b: feat: add local worker as llm in app (@Abirdcfly)
- 745833519eeba880d19b7047ef1ae438ea38a9b7: feat: add make prepare-push (@Abirdcfly)
- b5d630791d1576c9fca837f1a64aac831295bd42: feat: add model service CUD API (@Lanture1064)
- bc1df2030853b677f21ba2008b88992891ceace0: feat: add more chat api (@Abirdcfly)
- a25474a4f0e6e37b66373df7183f6c797054dce5: feat: add more config for app (@Abirdcfly)
- 8c4fd2c2744541f23513bf08f73678b13ebea08c: feat: add more detail log in chat api (@Abirdcfly)
- d41c1b342d54ea1c4d7c9acedd76175a1e51f77f: feat: add parameter whether to enable oidc (@0xff-dev)
- 1166d27e838f7a43f735215c42b0103795444891: feat: add prompt controller (@bjwswang)
- 9351150dbbd52a0cf6a5079e7aa4e4c51c8c6fe0: feat: add rbac rating CLI as an example (@bjwswang)
- 850d2d124f1c797914e4281f724d1062c340c7ef: feat: add spell test and fix existed misspellings (@Abirdcfly)
- 161a89f4e2c06b59b2a912d53403379506e897f1: feat: add swagger api doc (@Abirdcfly)
- e482d766fb51f8ac7880143307fe413390cca746: feat: add text-embedding in dashscope (@Abirdcfly)
- c3462f9591449bffc90062d3d1539f872fb63800: feat: add worker chart (@Lanture1064)
- 66f213a7ed8df99f6c46352bd5d5c682fe867806: feat: add worker graphql apis and optimize other graphql apis along with tiny changes to operator (@bjwswang)
- f4d1495a25074106f92bcf6bb5e61a7043d9d7c2: feat: add zhipuai embedding api & examples (@Lanture1064)
- 589f7eb198f7ce9fc3f58d869028a912b3f52a63: feat: breakpoint upload via MinIO (@dayuy)
- e886f5485fa6e2a5b8ffef3d1191d1450208d97b: feat: chat with llm now support sse (@Abirdcfly)
- a39191a20d88c128330a8791d5a05894957ec5eb: feat: check datasource bucket and object (@zqq454224016)
- 11393076d974e3542cdab8bd67b09d7011645ef1: feat: create and delete buckets based on namespace changes (@0xff-dev)
- 35f464cb8d7306bdd34d4f8a91c03abe771912a7: feat: create embedder&llm for worker based on model type (@bjwswang)
- 6bc9314e94051f772e77b280ff34744ef9f5ae4d: feat: dataset and versioneddataset impl (@0xff-dev)
- 89baee6e2843dde3e36cb4d6fa75f36488c41b6b: feat: dataset graphql api (@0xff-dev)
- ca63b19eeb2aa432a48bd828787d979a124fe38c: feat: define CRD Dataset and VersionedDataset (@bjwswang)
- c694d5f4450d131d724afad8761e41a66b2eedb1: feat: define CRD LLM and update helm charts (@bjwswang)
- 40b389989dd9efc77b6c50d39076ac87479bfe24: feat: deploy graphql-server (@zqq454224016)
- 009ac72f02ae5ecd60018d407f2ae0bc169fefca: feat: develop model management API (@zqq454224016)
- 1404c53433213c61978f0419e61b43dacbb9a40c: feat: enable AI evaluator for Rating (@bjwswang)
- ba1dafabb16d065d33a854082fc1708c694d3f98: feat: enable multiple gpus in worker (@bjwswang)
- 8b74fa18d2d28a5ca4ac55272d1ad19722908536: feat: enable multiple gpus(sinle node) in runner fastchat (@bjwswang)
- 746251be2c791f504b1126c909e7cc779046d747: feat: enable sse-invoke in zhipuai and standarlize response body (@bjwswang)
- 42817005a7b9fb1736b29a0b24767b35d8c2801b: feat: extract common funs in graphql server to pkg/common (@bjwswang)
- 0e489ea51c89a2a27395c5fcf522a8fd4f50e999: feat: graphql base framework for bff server (@0xff-dev)
- c748a5c9333908f24c04f75c2bf3b48e1c6c6efc: feat: graphql-server supplement (@zqq454224016)
- ed7e26238a49fb55a01a8de8154c424d24e26a1d: feat: impl dataprocessing list api (@bjwswang)
- 1c491d6c7e617db669f3d28c4dd8d5f8e3e6f063: feat: implement crd Model and define crd Worker (@bjwswang)
- 9c86805d59ce4337992574bad5954a516cab50aa: feat: implement CRD Worker (@bjwswang)
- 2290b8fa3f9da7b4dd10ba7ff774fface0328f07: feat: implement datasource management for arctl (@bjwswang)
- d064751fcdd9f8817be7b0adb9d8600730080e17: feat: init default controller config (@Abirdcfly)
- 91a670f8c89bf4a2fee89f277b2c10766e55e700: feat: initialize crds for llm service and prompt (@bjwswang)
- b4710dc83bb65c0f9d8115d83227a53556c04b35: feat: knowledgebase support local worker embedder (@Abirdcfly)
- bd762367b1349460edcf3d565052ca49cf158abb: feat: list datasources (@dayuy)
- 81cf8232092f06402c2ab015ffaf527d6a235b34: feat: list datasources in arctl (@bjwswang)
- 3aeb6255d21b9d31c56bc89ddcd9d23bf60095db: feat: list llms and embedders (@0xff-dev)
- 41545359b1c96c6a10e01ac73380b6ca9ca0bcf7: feat: manage local dataset with arctl (@bjwswang)
- 45b17867a33bd92cf288ad0d8585714600b3d2e2: feat: optimize graphql-server for portal along with operator implementations (@bjwswang)
- e612dc076ba5e3a7ced781345347876941884c6b: feat: optimize model service apis (@bjwswang)
- 008a40aedd74e2802747e5a640437b5d45349502: feat: refactor code and modify the function for process detail info. (@)
- 3f567ffc19c1b0c443e88306f568fb995a64ea0c: feat: refactor the graphql generation structure (@0xff-dev)
- b1359041aefefe244bf521cf6ff914b7d54797da: feat: remove knowledgebase should remove data in vectorstore (@Abirdcfly)
- 813660c00680f5a4fa4c7fea4ffd29b0333a0253: feat: retrieve files from Minio for data processing (@)
- 7702c09b844148cafd8a84b133409a522d9274da: feat: set creator value in apiserver (@Abirdcfly)
- fc354bc4604e1de5c579fba6b1e5821ce7edf051: feat: show skip handle file in knowledgebase status (@Abirdcfly)
- e437c5d78f923ba04b93d5308756fe23c030d7d3: feat: support ZhiPuAI and update crd definitions (@bjwswang)
- 33d6a3360ba3544b08c110b1dae2e67c04136b9e: feat: support api prefix for graphql playground (@0xff-dev)
- b9bef79459c485153411742d43c35bde67a703d7: feat: support for downloading model files via rdma (@0xff-dev)
- 340e454e89aa30cb74a9f337bd0a78836108b99a: feat: support for reading csv files with several rows (@0xff-dev)
- 42a56cab676fdda0f81d4649256537086f33d320: feat: support for uploading folders in this current example (@dayuy)
- 8fb25ecfbae0cdc2b9ae01c32d0866d5748c4e15: feat: support minio object tag for knowledgebase (@Abirdcfly)
- 5f2273a2144836490b9725a08d9e333d3136e988: feat: support oidc auth (@0xff-dev)
- 2d523e16d0486755ed8e1cacbec663082a762194: feat: update arcadia helm charts and add minio as system datasource for arcadia (@bjwswang)
- 4684ebf1089efd58070759961e7beb6e02d39311: feat: update datasource api (@zqq454224016)
- d25f12291bb0b3fe595ad47f178dc453a39961cf: feat: use complete model typed objec reference as input for worker creation (@bjwswang)
- acd3b86d070d9ac4a60ad8078de21da330922af3: feat: utlize worker's UID as the model registration name (@bjwswang)
- e17071747392e32b61268923b913eb541d086cd0: feat: versionedataset graphql api (@0xff-dev)
- c731b4422d70a881db3b351e498e6af7ffa0992d: feat: when no userPrompt setting, we use default one (@Abirdcfly)
- 178f8a12b9d29d58a38d86fd4db8dfaac789eabf: feat: worker support VLLM (@Lanture1064)
- f71511a5ac2128b210739bc633c8d6746c68c9b4: feat:Add Data Processing List, Add, Delete APIs, and Dockerfile (@)
- fdc315e96e11ab7019458c9137bebbb7271a5e81: feat:add a 'namespace' parameter to the data processing API interface. (@)
- 20c51cf6819a89c0ebe2c4da6c48c65b9e107a4a: feat:add data processing listใadd and delete APIs for graphql (@)
- 962db15e3ea37c62b027ba7cd3d97355a754b612: feat:add parameters related to file processing progress in the details for graphql (@wangxinbiao)
- dd3cc7182446232f79923a8ee85d817703a56b22: feat:add progress functionality to the details page. (@wangxinbiao)
- 9e487326f5841e639f02a7ad6f12cb62111cca8f: feat:add the openai support and remove async in the most functions. (@)
- bc4987c853867c9b68c85d7f1094293de9e460a0: feat:check for existing names during creation. (@wangxinbiao)
- 9d32130f1b1c1a2e48e65957bee72f4179544e6a: feat:data processing details for graphql (@)
- c3459a3f0903ba878dbc76c43e19f93b52ee7f8f: feat:generate Q&A pairs from text (@)
- 2a46f4000d8a5316860be3b816476df680298dfb: feat:handle dataset status (@)
Bug Fixes
- 85f88eb2fb128a6262ac95e1be9f32ff37b800c6: fix: MapStr2Any will panic (@Abirdcfly)
- 828afa736f2a9d8fa4300de1dbe3477e6274427c: fix: Modify automatically generated files (@zqq454224016)
- 918e43da1cec0cd3da67b186d53bddd518381d94: fix: add create permision of subjectaccressreviews to arcadia service account (@bjwswang)
- 2a2c97c4cb090e73f4ccbc54c58393bf067fa182: fix: add http probe and profiling; update to correct arcadia image (@bjwswang)
- cf5774cacc7490206dedd6b8e20a58b4f1914f5c: fix: add pkg into Dockerfile (@bjwswang)
- 17466557562e0dcae7733ca38e27a9b3ba534072: fix: add unique id to different documents (@bjwswang)
- abcbdc4751e4bc7c6789ae94cc0f33b684ca9d8a: fix: add unmarshall func to reponse (@bjwswang)
- e45ed460c6b545171be748203ca91a3e6ca8b273: fix: add version count and file count, update gql (@0xff-dev)
- 93218229e144af2ddaa7a99fae161288dd0fbe9b: fix: application graph cant update llm name (@Abirdcfly)
- ea9801b44a2da13f713ab54854b1f65704e267db: fix: bump arcadia chart version (@bjwswang)
- 2f826238e2943bff380556f8861168bc65f83ab5: fix: change model's type to plural; add example to call worker apis (@bjwswang)
- 054f683bf13c80a49bb8a158b457ae3c135c5961: fix: chart release workflow and README (@bjwswang)
- 3ad9182701e81a60b1d4cff328496bf6dfedbb44: fix: check if the resource is in deletion (@0xff-dev)
- fa9fc6fe87eea18ba4c6f6826a338483946e1a68: fix: config minio secure and skip https authentication (@0xff-dev)
- afba43fdbe8cf2ec2b63f98cb07cee35cf544a54: fix: correctly display knowledgebase return status (@zqq454224016)
- d3d57829f931a25b3b5b49de6d49053615490c7b: fix: dataset is not configured field fields (@0xff-dev)
- 7c5403117ed3cdc456fcfae492aece2fb104abc5: fix: delete model files when model got deleted (@0xff-dev)
- abd7b73bd2cd673d9cc28a59f08a4a331e2d6f55: fix: fixed an issue where services deployed via helm are dependent on each other and do not start (@0xff-dev)
- 7dd424ac431400b99f79a9f88c4c23388775124c: fix: get more accurate emberder segmentation (@Abirdcfly)
- 0de13a555d55d978441f0c1a1cfeb24be55f61da: fix: golangci-lint errors (@bjwswang)
- 33c7ccc9fabad5e629132eb395e9ce4249575e50: fix: graphql-server can't run (@0xff-dev)
- ec82d38366dd3e96fdade7d02d53b39074dc5265: fix: ignore Create if condtions not zero (@bjwswang)
- 5394a5268b50b20c7e7715ef6e931e7ddb288e88: fix: ignore already exist error in worker reconcile (@bjwswang)
- 631b339b1d8b76133104719f58b4a54a2346d4b4: fix: invalid Chart versions and images (@bjwswang)
- 14e6a27c2297b75c9a2e34f871ea7616a94b2184: fix: knowledgebase should reconcile fileGroups updates (@Abirdcfly)
- 11fe3932ded96133af7e1305c091766599988ac8: fix: knowledgebase should use versioneddataset (@Abirdcfly)
- 17db54e3fe5e94ccc8237ac7360d3a9aca4b9af8: fix: knowledgebase.spec.fileGroups[*].path use path in versioneddataset (@Abirdcfly)
- cc5f018c6a453d7d28f31a1a379a5c6e14da8dd6: fix: knowledgebaseretriever update scoreThreshold default value from 0.7 to 0.3 (@Abirdcfly)
- ed07bcb4b4570a77a4d14d6f93e1d2ab3202ce2b: fix: minimize permissions to arcadia (@bjwswang)
- c9ea4909900325c231a529d047ce34ef886e5458: fix: missing resource namespace when update (@bjwswang)
- f8e55b7d8aac94f578d5f7733a710c7f53297d91: fix: model add api field (@0xff-dev)
- 98c573b03b31feced7900bc463169eef4670e308: fix: modify knowledgebase and model field (@zqq454224016)
- 96b9dbdaf1fab10911f16ec370ad8a10e9f47596: fix: optimize chromadb configurations (@bjwswang)
- c4190cad4fa0c90685f0b77cdbda8c95f369ef99: fix: optimize llm checks (@bjwswang)
- cd8d3b94586041735035f8668366869d539ab6c8: fix: optimize rbac inqury promt (@bjwswang)
- 4a0b85677cf35546e49fa7dbc473539e83e85f59: fix: page panic (@0xff-dev)
- c73150d5e517d20ff997caa36a7defc1e92ad74b: fix: portal & minio env values (@Lanture1064)
- e4331bd861ef53014020a3ccb82d2ce1b00aa53e: fix: reconcile logic bugs in prompt and llm (@bjwswang)
- e13a2ca74d9144f0d4186a811ad9949ccedab293: fix: refactor dataset and versioneddataset (@0xff-dev)
- fa2d3b3ae4fbfc1d6a74fc5a78211eb8fe1986eb: fix: remove client-go oidc cache (@0xff-dev)
- 66a98a9ec0962df6b8c530d04746249e56351cdb: fix: remove minio from arcadia charts which use kubebb componentplan;update docs (@bjwswang)
- d12a42ef565911f59ffcead7881f9cb2e9ecd201: fix: remove minio uploadid cache (@0xff-dev)
- 85b999664904cba59bf25d2393c418d4e6ad2d82: fix: remove post-upgrade to arcadia;update graphql-server readme (@bjwswang)
- 7c674945427b20d56e01952bae2554a6878e6da6: fix: rename bucket name, and add missing permission (@0xff-dev)
- 00d6794e4233fc7ae28569e00e0476946104c75a: fix: rename fileGroup.datasource to fileGroup.source (@Abirdcfly)
- acbf241676fcd2d0db161c39c6d108e0673b3c60: fix: return the total number of rows in csv file (@0xff-dev)
- cccb3f0a1671bfc4037792b7301215f534273570: fix: set default vectorstore (@zqq454224016)
- 6ebb85ce4c6c3cf707e518dd056d923e5961f85a: fix: skip to fetch system models if the ns is system namespace (@bjwswang)
- 1c2dd59d4663715dff5ae1a064f8ccb0fd40653e: fix: some github action failed due to refactor (@Abirdcfly)
- dbf173dad7913dd3e71dbe4336a2f9d4fb2a71a3: fix: supports synchronization of already uploaded data (@0xff-dev)
- 55516c24e0d374a9f69d44c76072ee02f7cef889: fix: the data list is sorted in reverse order and supports returning data processing status (@0xff-dev)
- 9db49eba1ced974209b9474cc90f5990c82de954: fix: tiny changes to vectorstore chromadb (@bjwswang)
- 76d0ba89a97c6d2f4fb700d57c4a38183d596b49: fix: tiny changes to vectorstore chromadb (@bjwswang)
- 216f9aea87bc1f6581331026620fa0a559688bf2: fix: trim prefix from the versioneddataset file path (@bjwswang)
- 7cdc3e57cea293bd8b0f3d9973087f2d067f1ae9: fix: typo (@xxxxibo)
- 8bc531ece943bc9bc5176c1313b17940559dffbf: fix: unmilited page size not working in llm/embedder (@bjwswang)
- c3911c3466576faa98ef0683373b0c6100114ec3: fix: update app graph api (@Abirdcfly)
- 311be84e58f17321028a93c29a8276f6f333650b: fix: update graphql base on GRL_SDK_GENERATOR_IMAGE update (@Abirdcfly)
- 737b8e26f9b0b5d65ee21d539335fc5c10adcf3a: fix: update knowledgebase to display filedetail.status (@zqq454224016)
- 26c788ea11f537bf1d224515b4be1816c83e2c96: fix: use 1 Hour to replace 1 minutes for long time reconcile (@Abirdcfly)
- 1aac456d7f8f6ffe595b06d97f414482cf84b1dc: fix: use ClusterIP for chromadb by default (@bjwswang)
- 13c33c2643bd43ac02a4ccf09bde289ad5a0eb75: fix: use RecursiveCharacter to replace TokenSplitter to skip net req (@Abirdcfly)
- 463138980692299efe4b4a5dd71277199a8d1650: fix: use condnition.status as the model status (@bjwswang)
- e023df25bbcc777906cb0f60b0bcad824b12832e: fix: use gin for minio url (@Abirdcfly)
- 6d2db8156e2c0a28ddb5fc6da3125a4273b8d379: fix: vectorstore retry too quickly (@Abirdcfly)
- 17832f0134792e7e7d9615cb94cedc80f6ca68b6: fix: when no knowledgebase setting or is empty, we should ignore it (@Abirdcfly)
- bbec743d6b667def94305c81c8493daac3118556: fix: worker's updatetime refreshed unexpectedly (@bjwswang)
- bff456c9aec874b8847a95e300d0f1d2f14af039: fix:add PostgreSQL connection pool (@)
- e3ab1431dbc43dbca56f47057e148a521d7420fa: fix:add the uniform file path prefix from Minio to the environment variable and use it. (@)
- 54af00295504acff994e54a71a84bbfbd2164456: fix:bugs when check datasource;add hook weight to makesure oss created after minio (@bjwswang)
- cc220f55edcbf3fc91ba6bd8853b2e9f79635067: fix:optimization of QA splitting (@wangxinbiao)
- 12f620bdcd8a4e792a60c21bd6f4eafa96ba7c2e: fix:reslove merge (@)
Others
- 74c7ff1a47ed20f34519f788622f19faa817ba16: #405 init postgresql data during pg start for 1st time (@nkwangleiGIT)
- 10728f3c34e522e43aaaea67deb825ee17b419a5: Create README.md (@ggservice007)
- 3f1bb27e03b10ab2ab59c16dc1418ef0334a0183: Fix doc links and move some docs to website (@nkwangleiGIT)
- bb7cb2929a7968ab45b6dcc5ead248a13299135e: Fix issues and add doc about how to use streamlit (@nkwangleiGIT)
- 98bd3d13f89bc40f33bbce6c3b7cb0f3ecd4c6f3: Fix package issue and add default models (@nkwangleiGIT)
- 957b966eb93f162f9fa9c45876f25c5a8af34c4a: Fix some issues and add streamlit app samples (@nkwangleiGIT)
- 137c0fecc4c95f798ad68c4f18cc6676ddd27a87: Fix sse support issue for streaming mode (@nkwangleiGIT)
- 822d8d6a63d09593d96f0d66b5800e2033167d9d: Fix test failure (@nkwangleiGIT)
- 1b668f22fcde2bc0b3b42568cc9ba9fcd9e174ff: Merge branch 'main' into bjwswang (@bjwswang)
- f32efe9c39ffaaa96fd4f50b38e04c0b2f791b2c: Merge branch 'main' into dev (@bjwswang)
- 6e42f761cff0d1a78a52e2202efd861c25b7930b: Merge branch 'main' into dev (@bjwswang)
- c957c0ed14c28017bdbe02a4c670f500ddefc908: Merge branch 'main' into gql (@bjwswang)
- 37861fd740377bcdb931387c8953319b51b3feab: Merge branch 'main' into main (@bjwswang)
- ec04772aae67f1efcc5ec51591e1d84ff85abcaf: Merge remote-tracking branch 'upstream/main' into main (@nkwangleiGIT)
- b9e8abe6b51eceaa98e45a1cd985b3fe5867d783: Move docs to website repo and fix LLM model data (@nkwangleiGIT)
- c28a35b2bbb197de2281b32b85ea82fb21b64c14: Refine code structure (@nkwangleiGIT)
- 9ee427a3c25f3153f77325208ec6192beb0770f0: Refine helm package and add installation docs (@nkwangleiGIT)
- 6d532131f4ced573bc34a7878727852d6887eae7: Refine some code logic and add streamlkit data-app support (@nkwangleiGIT)
- 05c8bb948fb44cdbfd3cdfd06d5f68a7aee58621: Update Chart.yaml (@Lanture1064)
- 2c455b4e64560467bceda32fb3ecc539b673aa72: Update Chart.yaml (@Lanture1064)
- 7c951c530fc1663f3d01329ea59b58b7fb371424: Update doc link, menu and remove llm/secret from samples (@nkwangleiGIT)
- a91531ba22ed56939d60c2a2d4721f021c291bbb: Use shared LLM service for tests (@nkwangleiGIT)
- e7f32760623297a4a52156433a67bdc38cfb4ee9: add load command for chat server example (@Lanture1064)
- 542a5fde66415ead9e0ba6e28e55b71567e52cb9: chore(helm): update arcadia portal menus (@Carrotzpc)
- 0430e9b2dab7aa0bb6910677759f6824651fc793: chore: Update auth gql & related pkg (@Lanture1064)
- ed0cde86c836622112f3fab6ee8cefb88023c60d: chore: add bucket and bucket_paht query parameter (@0xff-dev)
- 70b37582461cfbba5f037af412c6829098e12566: chore: add data-process image build to workflow (@Lanture1064)
- 11c10cedfdf2a52d605561c3b7130e30c97c4e0a: chore: add datasource check apis;print the graphql server Raw Request and raw response (@bjwswang)
- 14e5c59c82b7eea33b132037f0b49e483e99319f: chore: add some drawings (@bjwswang)
- 3413d74ae804e1f45b541035f42544935734ab89: chore: add validation rules to the versioneddataset field (@0xff-dev)
- 207c73a02370e83ab7d8c75fd55ccdc847b371d9: chore: add version release action (@Abirdcfly)
- 863b06f5283d6e387207bf38e78dc808ccf78f4b: chore: bump arcadia chart version (@Abirdcfly)
- 31bafe16e5206538710b848e6a8ba43420080487: chore: bump helm/chart-testing-action version (@Abirdcfly)
- 648bf6f8a5a33a4c208be52e7d619719db87fc88: chore: bump image in chart arcadia to use the current tag (@bjwswang)
- 798c6aeb0e59db8bc052779d8a53f81d32009e4d: chore: bump k8s cluster version from 1.24.13 to 1.24.15 (@Abirdcfly)
- c8ea80d1a44255a3951912472e7efc73f6520e1a: chore: cache the total number of lines in the csv file (@0xff-dev)
- 0d7c818645b7d279bcbdb946749892ed4c4af2de: chore: change default image and service name for fastchat (@bjwswang)
- 3eec8c29a50d42dab83e516ac7637a16ee324143: chore: correct namespace controller rbac (@Abirdcfly)
- 0a75e2d9907e0e361da084c284830ea2c7a6d244: chore: disable dataprocess pod in example-test (@Abirdcfly)
- 8de1e45e431bebb86b4ec3b1679f411d62267329: chore: expose ingress settings for fastchat in arcadia (@bjwswang)
- 7e6c39e59763787d0de5b230f35d1b2296d395cc: chore: fix bugs in update/delete ms (@Lanture1064)
- 131df69361cd4460937942f78499c0b045933d11: chore: fix embedder controller (@Lanture1064)
- b07181ae3b12025c21456f60f8e9f90c1b43238f: chore: fix goreportcard link and misspell reported by goreport (@Abirdcfly)
- 92697be7e7deb463ad600413a3af66c0573a58db: chore: fix update embedder bug (@Lanture1064)
- 87d578ada52f4b7fb592528aad84b4db0d4f396a: chore: increase default proxy-body-size for nginx ingress in minio (@bjwswang)
- c220249abbfd4c181015ccfdb19230e0e86d7826: chore: invalid syntax in model.gql (@bjwswang)
- 413a91eac172fdfa38206a5d0e6f7c7bd5b5c83d: chore: lint data-process code with pylint and optimize the dockerfile (@bjwswang)
- e21516c9cae75c353b8fc2558179ed9427cf6901: chore: make sure embedding and chat use same LLM (@bjwswang)
- 78b1c4a48494eab2a2b8be8b238577a701fe07fc: chore: model support returns a list of document files (@0xff-dev)
- fb4cee51b74c45b86d36c69a8b9ddd499b1e1851: chore: modify the file filter structure (@0xff-dev)
- fc2d0736bf3c132c4f59f473682611c35b795615: chore: optimize graphql-server chart (@0xff-dev)
- e554a9fb990048b71488533ff24f15cb6bbdc28d: chore: remove the bff-sdk directory & add the command gql-sdk-upgrade to the Makefile (@dayuy)
- c5b09290d7c1ee98189b12a181afa35571f36cc3: chore: remove unused llms (@bjwswang)
- b2de8099e0d9112edb350dfdf1dcf7007426ef8c: chore: typo in graphql gql fil (@bjwswang)
- 4a15b88e2d8a20b570f023da2d14a738fda2eb76: chore: typos in kubeagi.yaml (@bjwswang)
- a211d9ad511a14b1c19c4bfc6f96110ee47670f9: chore: update doc and change the arguments (@bjwswang)
- 2754116902c3fe9058406b9dcf46902c7a9a6989: chore: update docs and set default image to specific tag (@bjwswang)
- 4589e6fef1092d600ff34e4800a12fe364df1c12: chore: update github action && add docker go proxy auto config (@Abirdcfly)
- aa8009e9c903f27df6c53a2912ca6f308c460d86: chore: update some default value (@Abirdcfly)
- b69b195071b9ad525217d9bf51b8545a247024ab: chore: update worker's dockerfile and use github action to build images (@bjwswang)
- 679ad160ef37cc9b9b40a6c3b3116a7f70e764ca: chore: use a more simplified reason Running instead of WorkingRunnig (@bjwswang)
- a7d1d548ab42b43e8a62296f085d6c96ea0b7a4c: chore: use golang errors replace k8s.io/apimachinery/pkg/util/errors (@Abirdcfly)
- 3aaf391dc29aa821ca8fe87dcf7b51bd01698923: chore: use kubeagi as the base repository (@bjwswang)
- 7bb5b6023b63b1063e5ee069b207d06970191005: chore: use langchaingo/chroma vectorstore and graduate our chromadb implementations (@bjwswang)
- 415d60702745fc80c41055ce93bf6bb86b390b3d: chore: use same common spec in worker's llm/worker (@bjwswang)
- cbd517d620322bcd6706140e707ed5b99f163250: cleanup: remove useless crd laboratory (@Abirdcfly)
- d5bd6acfb7d3d987c6cb146f510956ac2c9bc0e3: doc: update graphql-server readme (@Abirdcfly)
- bdbac58176962bed664a5e26e18d4edad67c6c50: docs: add some assets for dataset and local llm (@bjwswang)
- d9b6641d998fbd143628e663603e39a9a64eee75: docs: schedule a kind cluster with GPU enabled (@bjwswang)
- 283a11fabba3032d6fe8bb04a446724f5d11dba2: docs: update README (@bjwswang)
- 7ef54d5f026d23fcfbebd3f052c3b7209c6ffbd4: docs: update README.md (@bjwswang)
- e5106bc9c2330b51a8694754f63763b25eb057f4: docs: update document (@bjwswang)
- 8c021bd30107451075626e1da8b70eae66424a88: refactor: CRD datasource to fit product design (@bjwswang)
- 8e4be8a8d00d5b25742188822ed17b8df3d2c7a8: refactor: Extract LLM validate logic (@Lanture1064)
- 11ff7f1bc35664120a7b2d14c9279207432797c0: refactor: definition of versioned dataset (@bjwswang)
- 13e9ce35c765165d65d5e5d4a10cb2eee2169c94: refactor: minio (@0xff-dev)
- 93e48a4ebbc43c479a14c1aae7981becc639df88: refactor: optimize dataprocessing config (@bjwswang)
- b23d6f9f761115eac62098df6c94a72420cf9caa: refactor: remove spec.input and spec.output of app node crd (@Abirdcfly)
- 0db5df89bb5204b813e47405bccec1b10e69c0a3: refactor: rename graphql-server as apiserver (@bjwswang)
- 7147b96b84fed97eb3f070ef0b3a4ed5cafc3447: refactor: use DeleteCommonInput to replace other structures with the same fields but different names (@Abirdcfly)
- 047f4ffec5b7acaaf69f3504f9f21cd52b329f25: refactor: use getClientFromCtx to simply code (@Abirdcfly)
- 593662c6370794c9d45e20ffc3b4298c5aeeeed9: update (@Lanture1064)
Thanks to our Contributors!
Thank you to everyone who contributed to v0.1.0! โค๏ธ
And thank you very much to everyone else not listed here who contributed in other ways like filing issues, giving feedback, testing fixes, helping users in slack, etc. ๐