Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
APACHE-2.0 License
Bot releases are hidden (Show)
Published by wForget over 3 years ago
0.11.0 is an important version led by MobTech with the help of WeBank.
This is the next release of Linkis 0.10.0 base line. It contains 20 bug fixes, improvements and enhancements since 0.10.0.
The release of Linkis 0.11.0 is inseparable from the contributors of the WeDataSphere community. They selflessly contribute their codes and actively carry out technical exchanges with community partners. With their help, Linkis 0.11.0 can be successfully released. Thank you all Contributors to the community! Rank in no particular order:
wForget: Implement elasticsearch engine and gateway routing plugin , implement other enhancements and fix some bugs.
Yogaflre: Implement presto engine and presto resource management.
77954309: Shell engine supports custom variables.
xfei6868: PySpark tasks adapt to Spark3.0.
hcl3039359: Modify the length of the name field in the linkis_udf_tree table.
linweijiang: Fix the problem of user cookie loss after accessing single sign-on.
cumtcwf: Fix the bug of token verification.
zhangxhmuye: Support shell engine result set output.
0.11.0 是在微众银行的倾力帮助下,由 MobTech 主导完成的一个重要版本。
这是基于 Linkis 0.10.0 的下一个发行版本。自 0.10.0 起,本次版本包含了 20 个Bug修复,改进和增强。
Linkis 0.11.0 的发布,离不开WeDataSphere社区的贡献者,他们无私地贡献自己的代码,积极地与社区伙伴进行技术交流,有了他们的助力,Linkis 0.11.0 才能顺利地发布,在此感谢各位社区的贡献者! 排名不分先后:
wForget: 实现 ElasticSearch 引擎,实现网关路由插件,其他若干功能实现以及BUG修复。
Yogaflre: 实现 Presto 引擎,Presto 资源控制。
77954309: Shell 引擎支持自定义变量。
xfei6868: PySpark 任务适配 Spark3.0。
hcl3039359: 修改 linkis_udf_tree 表中 name 字段长度。
linweijiang: 修复接入单点登录后用户 cookie 丢失问题。
cumtcwf: 修复 Token 校验的 Bug。
zhangxhmuye: 支持 Shell 引擎结果集输出。
以下为Linkis安装包资源:
https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Linkis/0.11.0/wedatasphere-linkis-0.11.0-dist.tar.gz
Published by brianzhangrong almost 4 years ago
0.10.0 is an important version led by Ihome with the help of WeBank.
This is the next release of linkis 0.9.4 base line. This version aims to expand the capabilities of Linkis in containerization by introducing the features of Linkis on kubernetes, reducing everyone a lot of time for compiling, excluding JARs and adapting to the new environment, allowing Linkis to achieve high SLA and satisfy 7*24 business requirement. It provides financial-grade reliable capabilities for everyone’s big data platform.
It contains 1 bug fixes, improvements and enhancements since 0.9.4.
[Linkis-440] linkis on kubernetes enhancement
[Linkis-440] use configmap as config server enhancement
[Linkis-440] use ingress-nginx to guard nginx ha enhancement
[Linkis-440] use fluentd-es to collector micro-service log enhancement
[Linkis-440] put front static file in kubernetes pod enhancement
[Linkis-440] adapt k8s network model,register pod ip to register center as service discover
[Linkis-440] use envirment to pass eurekaURL,jvm params
[Linkis-440] removing implicit dependencies
[Linkis-440] spark-engine pod use static route and ip masque to communicate with spark executor
The release of linkis 0.10.0 is inseparable from the contributors of the WeDataSphere community. They selflessly contribute their codes and actively carry out technical exchanges with community partners. With their help, linkis 0.10.0 can be successfully released. Thank you all Contributors to the community! Rank in no particular order:
brianzhangrong: As a host, contributed the entire plan of linkis on kubernetes.
irusist: bml stored filename
chongchuanbing: removing implicit dependencies
lidongzhangg: use configmap as config server
hds1999: use envirment to pass eurekaURL,jvm params
This version mainly provides the features of Linkis on kubernetes. If you want to use the containerization capabilities of this version, please visit: Linkis Containerization Deployment Guide
Linkis docker image packages
URL: https://hub.docker.com/repository/docker/wedatasphere/linkis
Password: Personal account and password
0.10.0是在微众银行的倾力帮助下,由艾佳生活主导完成的一个重要版本。
这是基于linkis 0.9.4的下一个发行版本。 该版本旨在通过引入Linkis on kubernetes 的特性,扩充Linkis在容器化这块的能力,节省大家编译、排包和适配新环境的大量时间,让Linkis做到高SLA,满足业务7*24使用的要求,为大家的大数据平台提供金融级可靠能力。
自0.9.4起,本次版本包含 1 个Bug修复,改进和增强。
[Linkis-440] linkis on kubernetes 特性。
[Linkis-440] kubernetes configmap 作为配置中心特性。
[Linkis-440] 使用 ingress-nginx 把nginx 放入kubernetes集群内。
[Linkis-440] 使用 fluentd-es 采集 micro-service日志
。
[Linkis-440] 前端静态文件放入k8s集群内。
[Linkis-440] 适配k8s 网络模型,注册 pod ip 到注册中心用作服务发现。
[Linkis-440] 使用环境变量传递 eurekaURL,jvm params。
[Linkis-440] 去除各微服务对cloudmodule的隐式依赖。
[Linkis-440] 静态路由+ip 地址伪装,解决spark executor 到 spark-engine的通信问题。
Linkis 0.10.0 的发布,离不开WeDataSphere社区的贡献者,他们无私地贡献自己的代码,积极地与社区伙伴进行技术交流,有了他们的助力,Linkis 0.10.0才能顺利地发布,在此感谢各位社区的贡献者! 排名不分先后:
brianzhangrong: 作为主持者,贡献了linkis on kubernetes的整个方案。
irusist: bml stored filename bug定位
chongchuanbing: 移除对cloud-module的隐式依赖
lidongzhangg: linkis.properties配置移到configmap,使用configmap作为配置中心
hds1999:使用环境变量传递eurekaUrl,jvm 参数到docker
本次版本主要是提供了Linkis on kubernetes 的特性,如果您想使用本版本的容器化能力,请访问:Linkis 容器化部署指南
Published by Alexkun over 4 years ago
The release of Linkis0.9.4 is inseparable from the contributors of the WeDataSphere community. They selflessly contribute their codes and actively carry out technical exchanges with community partners. With their help, Linkis0.9.4 can be successfully released. Thank you all Contributors to the community! Rank in no particular order: liangqilang: Contributed the code for httpclient to replace dispatchDavidhua1996: Contributed to the basic modules and function implementations of data source management and metadata management. zhengfan199525:Added hive's datasource management module. alexzyWu: Contributed to the server module of data source management. jaminlu:Optimized the directory structure and compilation of datasource. bleachzk: Contributed the common module of data source management. liaoyt:Added rest interface for datasource management. SelfImpr001: Contributed part of the data source management.
Linkis0.9.4的发布,离不开WeDataSphere社区的贡献者,他们无私地贡献自己的代码,积极地与社区伙伴进行技术交流,有了他们的助力,Linkis0.9.4才能顺利地发布,在此感谢各位社区的贡献者! 排名不分先后: liangqilang:贡献了httpclient替换dispatch的代码Davidhua1996: 贡献了数据源管理和元数据管理的基础模块和功能实现. zhengfan199525:添加了hive的数据源管理模块. alexzyWu: 贡献了数据源管理的服务端模块. jaminlu:优化了数据源管理的目录结构和编译. bleachzk: 贡献了数据源管理的公共模块. liaoyt:添加数据源管理的rest接口. SelfImpr001: 贡献了数据源管理的部分内容.
Published by chaogefeng over 4 years ago
Last but not least, this release would not have been possible without the following contributors:
nimuyuhan: Fixed SOF issues caused by regular expressions with SQL comment removal
wForget: Multiple versions of hive support ,includes hive1.x, 2.x, 3.x, etc and Multiple bug fixes.
最后但是最重要的一点是,如果没有以下贡献者不可能发布此版本,在此感谢各位社区的贡献者! 排名不分先后(按字母排序):
nimuyuhan: 修复SQL注释移除正则表达式SOF问题.
wForget: 增加了支持Hive多版本的特性和多个Bug修复.
我们提供了DSS + Linkis + Qualitis + Visualis + Azkaban【全家桶一键部署安装包】,由于安装包过大(1.3GB),Github下载缓慢,请通过以下方式获取:
以下为Linkis安装包资源:
Published by peacewong almost 5 years ago
Last but not least, this release would not have been possible without the following contributors:
allwefantasy: Added MLSQL engine.
chenxi0599: Fix filesystem print error in log.
wForget:Provides a release version of CDH5.7.6 for linkis.
hj2016: Fixed a bug caused by maxEffectiveCapacity parameter not being present when Yarn gets the maximum resources for Capacity scheduling..
houjunxiong: Enhanced metadata support for meta database type of Hive to postgresql.
Just-do-it-Fan: Enhanced ResourceManager module support for Yarn's Capacity scheduling.
liangqilang: Fix the bug that NullPointException is thrown when downloading files from httpclient and add the function of streaming download result set, etc..
leisore: Fix start and stop script naming issues.
nimuyuhan: Fix configuration file does not support Chinese bug.
patinousward: Fix multiple bugs and add table building function in metadata module.
zhanghaicheng1: Increase deployment and installation issue documentation.
点击跳转百度云 提取码: iyya
最后但是最重要的一点是,如果没有以下贡献者不可能发布此版本,在此感谢各位社区的贡献者!
排名不分先后(按字母排序):
allwefantasy: 增加了MLSQL引擎.
chenxi0599: 修复filesystem在日志打印错误问题.
hj2016: 解决当Yarn为Capacity调度获取最大资源时,由于maxEffectiveCapacity参数不存在导致的bug.
houjunxiong: 增强模块metadata对hive的元数据库类型为postgresql的支持.
Just-do-it-Fan: 增加ResourceManager模块对Yarn的Capacity调度支持.
leisore: 修复start和stop脚本命名问题.
liangqilang: 修复httpclient下载文件抛NullPointException的bug和增加流传输下载结果集功能,等多个特性.
nimuyuhan: 修复配置文件不支持中文bug.
patinousward: 修复多个bug,并在metadata模块中增加建表功能.
wForget:提供了linkis的CDH5.7.6可用的发布版本.
zhanghaicheng1: 增加部署安装问题文档.
Published by peacewong almost 5 years ago
Baidu Cloud Download Extraction code: iyya
Linkis upgrade from 0.9.0 to 0.9.1 guide
点击跳转百度云 提取码: iyya
Published by wushengyeyouya about 5 years ago
Published by wushengyeyouya about 5 years ago
Published by wushengyeyouya about 5 years ago
Published by wushengyeyouya about 5 years ago
Published by wushengyeyouya about 5 years ago