皇上,还记得我吗?我就是1999年那个Linux伊甸园啊-----24小时滚动更新开源资讯,全年无休!

Apache kylin 3.1.1 发布

[   ] apache-kylin-3.1.1-bin-cdh57.tar.gz          2020-10-18 10:56  271M
[TXT] apache-kylin-3.1.1-bin-cdh57.tar.gz.asc      2020-10-18 10:56  836
[TXT] apache-kylin-3.1.1-bin-cdh57.tar.gz.sha256   2020-10-18 10:56  102
[   ] apache-kylin-3.1.1-bin-cdh60.tar.gz          2020-10-18 10:56  268M
[TXT] apache-kylin-3.1.1-bin-cdh60.tar.gz.asc      2020-10-18 10:56  836
[TXT] apache-kylin-3.1.1-bin-cdh60.tar.gz.sha256   2020-10-18 10:56  102
[   ] apache-kylin-3.1.1-bin-hadoop3.tar.gz        2020-10-18 10:56  268M
[TXT] apache-kylin-3.1.1-bin-hadoop3.tar.gz.asc    2020-10-18 10:56  836
[TXT] apache-kylin-3.1.1-bin-hadoop3.tar.gz.sha256 2020-10-18 10:56  104
[   ] apache-kylin-3.1.1-bin-hbase1x.tar.gz        2020-10-18 10:56  271M
[TXT] apache-kylin-3.1.1-bin-hbase1x.tar.gz.asc    2020-10-18 10:56  836
[TXT] apache-kylin-3.1.1-bin-hbase1x.tar.gz.sha256 2020-10-18 10:56  104
[   ] apache-kylin-3.1.1-source-release.zip        2020-10-18 10:56   13M
[TXT] apache-kylin-3.1.1-source-release.zip.asc    2020-10-18 10:56  836
[TXT] apache-kylin-3.1.1-source-release.zip.sha256 2020-10-18 10:56   64

v3.1.1 – 2020-10-18

Tag: kylin-3.1.1
This is a bug-fix release after 3.1.0, with 37 improvements and 21 bug fixes.

Sub-task

  • [KYLIN-4557] – Refactor JobService to improve code readability
  • [KYLIN-4558] – get all chained executable jobs through job API
  • [KYLIN-4559] – show cardinality and lookup snapshot job on job page
  • [KYLIN-4560] – support to re-run/delete cardinality and lookup snapshot job
  • [KYLIN-4561] – overall job number statistics in monitor page is incorrect after change the job status

Bug Fix

  • [KYLIN-4515] – could not send mail on ssl port
  • [KYLIN-4578] – Throws TableNotFoundException in step ‘Convert Cuboid Data to HFile’ when the value of property * ‘kylin.storage.hbase.table-name-prefix’ or ‘kylin.storage.hbase.namespace’ is lowercase.
  • [KYLIN-4603] – listjob return NPE
  • [KYLIN-4610] – update kylin.engine.livy.backtick.quote default value
  • [KYLIN-4617] – Check whether project/jobid exists before download diagnosis package
  • [KYLIN-4628] – Fail to use custom measure type when specifying cube to query
  • [KYLIN-4634] – Fail to specify cube in model of low priority to query
  • [KYLIN-4656] – Guava classpath conflict caused by kylin-jdbc 3.1.0 jar
  • [KYLIN-4657] – dead-loop in org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork
  • [KYLIN-4672] – Using Real-time Lambda to refresh the data lead to result not incorrect
  • [KYLIN-4677] – StorageCleanupJob throw NPE
  • [KYLIN-4683] – Fail to consume kafka when partition number get larger
  • [KYLIN-4684] – Streaming Table V2创建 – TSPattern下拉选项前端bug修复
  • [KYLIN-4688] – Too many tmp files in HDFS tmp directory
  • [KYLIN-4697] – User info update logic is not correct
  • [KYLIN-4700] – Wrong engine type for realtime streaming
  • [KYLIN-4731] – Kylin query failing with ‘null while executing SQL’
  • [KYLIN-4753] – Merging job stop working after Kylin upgrade
  • [KYLIN-4755] – Error while compiling generated Java code when using Kylin UDF in “case when”
  • [KYLIN-4756] – user/group page has duplicate information between adjacent page numbers
  • [KYLIN-4757] – Impossible precision for decimal datatype in kylin if the source column is numeric in postgres

Improvement

  • [KYLIN-4527] – Beautify the drop-down list of the cube on query page
  • [KYLIN-4549] – Show column cardinality in rowkeys area of advanced settings
  • [KYLIN-4550] – Provide advanced refresh interface inside the refresh panel
  • [KYLIN-4551] – Provide interfaces to transfer cube/model/project ownership
  • [KYLIN-4576] – Add hint about password length
  • [KYLIN-4581] – Add spark and flink engine test case for release test
  • [KYLIN-4585] – Add cube count column for project table
  • [KYLIN-4606] – throw olap exception when olap query and pushdown both error
  • [KYLIN-4608] – add deletecubefast api for delete 300 cubes fast
  • [KYLIN-4609] – setenv.sh add zgc config for big memory
  • [KYLIN-4611] – modify PATTERN_SPARK_APP_URL to Tracking URL,ignore case
  • [KYLIN-4612] – Support job status write to kafka
  • [KYLIN-4616] – The value of config kylin.source.hive.databasedir can be self detected
  • [KYLIN-4618] – Upgrade kylin docker image for kylin 3.1.0
  • [KYLIN-4619] – Make shrunken dict able to coexist with mr-hive global dict
  • [KYLIN-4626] – add set kylin home sh
  • [KYLIN-4635] – Set Kylin default log level to info
  • [KYLIN-4653] – Make the capacity for the LinkedBlockingQueue of BlockingReservoir configurable
  • [KYLIN-4665] – set flink job name shown in resource manager
  • [KYLIN-4678] – continue execute job when StorageCleanupJob sub step has error
  • [KYLIN-4679] – StorageCleanupJob clean hive table support hive table prefix
  • [KYLIN-4685] – return user friendly msg when stackoverflowerror
  • [KYLIN-4686] – clean metadata support to delete all jobs
  • [KYLIN-4687] – add unify clean sh to excute some clean shells
  • [KYLIN-4709] – Upgrade spring to 4.3.26
  • [KYLIN-4712] – Optimize CubeMetaIngester.java CLI
  • [KYLIN-4714] – Failed to revoke role access of the project
  • [KYLIN-4716] – Optimize the project page
  • [KYLIN-4752] – Refine server mode checking
  • [KYLIN-4770] – Move Kylin service on k8s from background to foreground

Task

  • [KYLIN-4526] – Enhance get the hive table rows
  • [KYLIN-4648] – Upgrade Spark to latest 2.3 or 2.4 version

v4.0.0-alpha – 2020-09-13

Tag: kylin-4.0.0-alpha
This is a major release after 3.1.0, with 35 new features/improvements and 22 bug fixes.

New Feature

  • [KYLIN-4188] – Parquet as Cube storage V2
  • [KYLIN-4213] – The new build engine with Spark-SQL
  • [KYLIN-4452] – Kylin on Parquet with Docker
  • [KYLIN-4462] – Support Count Distinct,TopN and Percentile by kylin on Parquet
  • [KYLIN-4659] – Prepare a technical preview version for Parquet Storage

Improvement

  • [KYLIN-4449] – A running build job will still running when cancel from front end
  • [KYLIN-4450] – Add the feature that adjusting spark driver memory adaptively
  • [KYLIN-4456] – Temporary files generated by UT or Integration Tests need to be deleted
  • [KYLIN-4458] – FilePruner prune shards
  • [KYLIN-4459] – Continuous print warning log-DFSInputStream has been closed already
  • [KYLIN-4467] – Support TopN by kylin on Parquet
  • [KYLIN-4468] – Support Percentile by kylin on Parquet
  • [KYLIN-4474] – Support window function for Kylin on Parquet
  • [KYLIN-4475] – Support intersect count for Kylin on Parquet
  • [KYLIN-4541] – Kylin.log output error information during build job
  • [KYLIN-4542] – After downloading spark with bin/download-spark.sh , still need set SPARK_HOME manually .
  • [KYLIN-4621] – Avoid annoying log message when build cube and query
  • [KYLIN-4625] – Debug the code of Kylin on Parquet without hadoop environment
  • [KYLIN-4631] – Set the default build engine type to spark for Kylin on Parquet
  • [KYLIN-4644] – New tool to clean up intermediate files for Kylin 4.0
  • [KYLIN-4680] – Avoid annoying log messages of unit test and integration test
  • [KYLIN-4695] – Automatically start sparder (for query) application when start kylin instance.
  • [KYLIN-4699] – Delete job_tmp path after build/merge successfully
  • [KYLIN-4713] – Support use diff spark schedule pool for diff query
  • [KYLIN-4722] – Add more statistics to the query results
  • [KYLIN-4723] – Set the configurations about shard by to cube level
  • [KYLIN-4744] – Add tracking URL for build spark job on yarn
  • [KYLIN-4746] – Improve build performance by reducing the count of calling ‘count()’ function
  • [KYLIN-4747] – Use the first dimension column as sort column within a partition

Bug Fix

  • [KYLIN-4444] – Error when refresh segment
  • [KYLIN-4451] – ClassCastException when querying on cluster with binary package
  • [KYLIN-4453] – Query on refreshed cube failed with FileNotFoundException
  • [KYLIN-4454] – Query snapshot table failed
  • [KYLIN-4455] – Query will fail when set calcite.debug=true
  • [KYLIN-4457] – Query cube result doesn’t math with spark sql
  • [KYLIN-4461] – When querying with measure whose return type is decimal, it will throw type cast exception
  • [KYLIN-4465] – Will get direct parent and ancestor cuboids with method findDirectParentCandidates
  • [KYLIN-4466] – Cannot unload table which is loaded from CSV source
  • [KYLIN-4469] – Cannot clone model
  • [KYLIN-4471] – Cannot query sql about left join
  • [KYLIN-4482] – Too many logging segment info with CubeBuildJob step
  • [KYLIN-4483] – Avoid to build global dictionaries with empty ColumnDesc collection
  • [KYLIN-4632] – No such element exception:spark.driver.cores
  • [KYLIN-4681] – Use KylinSession instead of SparkSession for some test cases
  • [KYLIN-4694] – Fix ‘NoClassDefFoundError: Lcom/esotericsoftware/kryo/io/Output’ when query with sparder on yarn
  • [KYLIN-4698] – Delete segment storage path after merging segment, deleting segment and droping cube
  • [KYLIN-4721] – The default source source type should be CSV not Hive with the local debug mode
  • [KYLIN-4732] – The cube size is wrong after disabling the cube
  • [KYLIN-4733] – the cube size is inconsistent with the size of all segments
  • [KYLIN-4734] – the duration is still increasing after discarding the job
  • [KYLIN-4742] – NullPointerException when auto merge segments if exist discard jobs*

转自 https://kylin.apache.org/docs/release_notes.html

分享到:更多 ()