Apache StreamPark 2.1.0 Release 版本正式发布

杩戞棩 Apache StreamPark(Incubating) 绀惧尯姝ｅ紡鍙戝竷浜?2.1.0 鐗堟湰锛屽甫鏉ヤ簡璇稿鏀硅繘鍜屾柊鍔熻兘鐨勬洿鏂帮紝娆㈣繋澶у涓嬭浇浣跨敤銆?

鍦?2.1.0 鐗堟湰涓紝StreamPark 鍥㈤槦淇浜嗗緢澶氫緷璧栧寘瀛樺湪鐨勫畨鍏ㄩ闄╅棶棰橈紝閫氳繃浜嗕笓涓氬畨鍏ㄥ伐鍏风殑妫€娴嬶紝瀹夊叏鎬уぇ澶ф彁鍗囥€傛敮鎸佷簡鏈€鏂扮殑 Flink 1.17锛屼慨澶嶄簡 Hadoop 鐗堟湰鍏煎鎬х浉鍏崇殑鍘嗗彶 Bug锛岃鐗堟湰鏄?2.0.0 澶х増鏈?鐨勫寮轰慨澶嶇増锛屽叿澶囨洿楂樼殑鍙敤鎬у拰绋冲畾鎬э紝寤鸿鎵€鏈夌敤鎴峰崌绾у埌杩欎釜鐗堟湰銆?/p>

涓?/strong> 杞?/strong> 浣?/strong> 鐢?/strong>

Github: https://github.com/apache/streampark

瀹? 缃? https://streampark.apache.org/download

1.鏍稿績鐗规€цВ璇?/h2>

瀹夊叏鎬у崌绾?/h6>

• Apache StreamPark(Incubating) 2.1.0 鍦ㄧ郴缁熷畨鍏ㄦ柟闈㈠仛鍑哄椤逛紭鍖栧崌绾э細
  鏇翠负绮剧粏鐨勬潈闄愭帶鍒讹紝淇浜嗘潈闄愯秺绾ц闂殑闂銆?/p>

• 淇閲嶇疆瀵嗙爜涓殑鏂板瘑鐮佺‖缂栫爜闂锛岃繑鍥為殢鏈哄瘑鐮侊紝鎻愬崌绯荤粺瀹夊叏鎬с€?/p>

• 瀹屽杽浜嗙敤鎴风鐞嗘ā鍧楋紝涓ユ牸瑙勮寖鐢ㄦ埛绫诲瀷锛岀姝㈡煇涓€绫诲瀷鐢ㄦ埛浠ュ叾浠栫櫥褰曠被鍨嬭繘鍏ュ钩鍙帮紝濡?Ldap 鐢ㄦ埛浠?Password 绫诲瀷鐧诲綍銆?/p>

• 渚濊禆鍖呭崌绾э紝瑙ｅ喅浜嗗钩鍙板彂琛屽寘涓殑涓珮鍗辨紡娲炪€傚锛歨adoop 鍗囩骇鍒?3.3.4銆?jackson 鍗囩骇鍒?2.13.5銆乻pringboot 鍗囩骇鍒?2.7.11 绛夈€?/p>

• 淇浜?StreamPark 鑷韩鎵€鏈夊凡鐭ュ瓨鍦ㄧ殑楂樺嵄瀹夊叏婕忔礊銆?/p>

  鏀寔Flink 1.17

浣滀负娴佸鐞嗗紑鍙戠鐞嗘鏋讹紝StreamPark 鍦ㄥ Apache Flink 鐨勬敮鎸佷笂锛屼竴濡傛棦寰€鐨勮蛋鍦ㄥ墠鍒椼€傚緱鐩婁簬 StreamPark 鑹ソ鐨勬灦鏋勮璁★紝浣垮緱鏀寔涓€涓柊鐗堟湰鐨?Flink 闈炲父瀹规槗锛屽洜姝ゆ垜浠巼鍏堟敮鎸佷簡 Flink 1.17 [1]銆傚湪浣跨敤涓婅繕鏄竴濡傛棦寰€鐨勭畝鍗曪紝鐢ㄦ埛鍙渶瑕佹坊鍔犱竴涓?Flink 1.17 鐨勭幆澧冨嵆鍙紝浣滀笟鍙互鑷敱鐨勯€夋嫨 Flink 鐗堟湰銆?/p>

姝ゅ鎴戜滑杩樹慨澶嶄簡鐢ㄦ埛鍙嶉鐨?Flink Home 娌℃湁鍒犻櫎鍔熻兘[2] 鐨勯棶棰橈紝淇浜嗗綋 Flink Home 琚綔涓氬紩鐢ㄦ椂锛屼笉鑳戒慨鏀筟3] 绛夐棶棰樸€傝繖浜涙敼杩涗娇寰楃鐞?Flink 鐜鏇村姞瀹规槗銆?/p>

鏇村姞瀹屽杽鐨勪綔涓氭搷浣滆褰?/h6>

鍦?StreamPark 2.1.0 涓畬鍠勪簡搴旂敤绋嬪簭鐨勬搷浣滄棩蹇楄褰曪紝涔嬪墠鐨勫巻鍙茬増鏈腑鍙槸璁板綍浜嗕綔涓氬惎鍔ㄧ殑鏃ュ織锛屾湰娆″鍔犱簡浣滀笟鐨勫彂甯冦€佸惎鍔ㄣ€乻avepoint銆佸仠姝㈢瓑瀹屾暣鐨勬搷浣滄棩蹇楋紝闄や簡璁板綍姣忎釜鎿嶄綔鐨勫悕绉般€佹墽琛屾椂闂村拰鐘舵€佷箣澶栵紝杩樼淮鎶や簡涓€涓紓甯告爤锛屾柟渚跨敤鎴锋帓鏌ラ棶棰樸€?/p>

閫氳繃杩欑璁板綍鐨勬柟寮忥紝浣垮緱浣滀笟鐨勬搷浣滄楠ゆ洿鍔犳竻鏅帮紝浣滀笟瀹¤鏇村姞瀹规槗銆傛搷浣滄楠ゅ鏋滃け璐ヤ簡鑳藉甯姪鐢ㄦ埛蹇€熺殑瀹氫綅闂锛岄檷浣庣敤鎴蜂娇鐢?StreamPark 寮€鍙戙€佺淮鎶や綔涓氱殑鎴愭湰銆備娇寰椾綔涓氱殑鎿嶄綔閫昏緫鏇村姞瀹屾暣鍜岃嚜娲斤紝浜у搧浣撻獙鏇村ソ銆?/p>

浣滀笟鐨勬搷浣滄棩蹇?/div>

鏀寔澶栭儴鎵╁睍閾炬帴

鍦ㄧ敓浜у疄璺典腑锛屼负浜嗘洿濂藉湴绠＄悊 Flink 浣滀笟锛屽線寰€闇€瑕佸皢杩欎簺浣滀笟涓庡閮ㄦ湇鍔￠泦鎴愶紝渚嬪闆嗘垚瀹炴椂鏃ュ織璁板綍銆佹寚鏍囩洃鎺с€佸憡璀︾郴缁熺瓑銆?/p>

StreamPark 浣滀负涓€绔欏紡 Flink DevOps 骞冲彴锛屽鏋滆兘澶熸彁渚涗互鍔ㄦ€侀摼鎺ョ殑褰㈠紡闆嗘垚杩欎簺鏈嶅姟鐨勮兘鍔涳紝闆嗕腑鐨勫畾涔夊苟鑷姩搴旂敤浜庢瘡涓?Flink 浣滀笟锛屽皢浼氫负鐢ㄦ埛甯︽潵鏇村浠峰€笺€?/p>

鍥犳鏈鎴戜滑鏀寔浜嗘墿灞曢摼鎺4] 杩欎竴鐗规€э紝鎵╁睍閾炬帴鐢辨爣绛俱€佸悕绉般€侀鑹插拰閾炬帴缁勬垚銆傜敤鎴峰彲浠ュ緢杞绘澗鐨勫埗浣滀竴涓彲鐐瑰嚮鐨勫窘绔狅紝鍦?Flink Job 鍚姩鏃舵垚涓哄彲鐐瑰嚮鐨勫閮ㄨ繛鎺ワ紝浠庤€屽彲浠ュ緢鏂逛究鍦拌烦杞埌瀵瑰簲鐨勫閮ㄧ郴缁燂紝浣垮緱鐢ㄦ埛鍙互澶氭柟浣嶅湴绠＄悊鍜岀洃鎺?Flink 浣滀笟銆?/p>

娣诲姞澶栭儴鎵╁睍閾炬帴

浣跨敤澶栭儴鎵╁睍閾炬帴

鏀寔YARN闃熷垪绠＄悊

鍦ㄥ疄闄呯殑鐢熶骇鐜涓紝閽堝 Flink on Yarn 閮ㄧ讲妯″紡锛岀敤鎴烽€氬父闇€瑕佽緭鍏?Yarn Queue 鎴?Yarn Queue & labels 鏉ユ寚瀹?on Yarn 妯″紡涓嬬殑 Flink 搴旂敤绋嬪簭鐨勮繍琛岄槦鍒椼€傚湪姝よ繃绋嬩腑锛屾墜鍔ㄨ緭鍏ュ彲鑳戒細瀵艰嚧鎰忓鎯呭喌鍙戠敓锛屽锛氭寚瀹氫簡涓嶅瓨鍦ㄧ殑闃熷垪锛屾垨灏?Flink 搴旂敤绋嬪簭銆丗link 闆嗙兢鎻愪氦鍒伴敊璇殑闃熷垪绛夈€傚綋 Yarn 闆嗙兢涓笉瀛樺湪鐢ㄦ埛鎸囧畾鐨勯槦鍒楁椂锛岄儴缃?Flink 搴旂敤绋嬪簭 / Flink 闆嗙兢鐨勮繃绋嬪皢浼氭棤鎰忎箟鐨勮€楁椂锛屾渶鍚庢彁浜ゅけ璐ワ紝甯︽潵绯熺硶鐨勭敤鎴蜂綋楠屻€傜敱浜庤緭鍏ラ敊璇€屽皢浠诲姟鎻愪氦鍒伴敊璇殑闃熷垪涓紝甯︽潵璧勬簮婊ョ敤鐨勬儏鍐碉紝鍙兘浼氬奖鍝嶉槦鍒椾笂宸叉湁搴旂敤绋嬪簭鐨勭ǔ瀹氭€с€傜壒鍒槸閽堝澶ц妯′綔涓氱殑鎯呭喌锛屼細甯︽潵浣滀笟绠＄悊鍜屾不鐞嗕笂鐨勬寫鎴樸€?/p>

鍥犳鍦ㄦ湰娆＄殑鏂扮増鏈腑寮曞叆浜?Yarn 闃熷垪绠＄悊鍔熻兘[5]锛屼互纭繚涓€缁勬坊鍔犵殑闃熷垪鍦ㄥ悓涓€鍥㈤槦鍐呭叡浜紝涔熷氨鏄‘淇濋槦鍒楄祫婧愬湪鍥㈤槦鑼冨洿鍐呮槸闅旂鐨勩€傚畠涓嶄粎纭繚浜嗛槦鍒楀拰鏍囩杈撳叆鐨勬纭€э紝鑰屼笖缂╃煭浜嗙敱浜庨敊璇槦鍒楀鑷村簲鐢ㄧ▼搴忓け璐ョ殑鏃堕棿娑堣€楋紝灏芥棭鎻愮ず鐢ㄦ埛闃熷垪璁剧疆鐨勬纭€э紝甯︽潵鏇村ソ鐨勪娇鐢ㄤ綋楠屻€傚苟涓旀湁鏁堥槻姝㈡互鐢ㄩ槦鍒楄祫婧愮殑鎯呭喌銆?/p>

娣诲姞YARN闃熷垪

鍏朵粬鏀硅繘鍜屾洿鏂?/h6>

• 淇绯荤粺鍒濆鍖栭樁娈靛湪鏌愪簺鐗瑰畾 Hadoop 鐗堟湰涓嬶紝瑙ｆ瀽閰嶇疆鎶?"30s" 鏍煎紡鍖栭敊璇殑 Bug #2443
• 淇 Savepoint 鏃堕棿杩囬暱瀵艰嚧鐨勪綔涓氱姸鎬侀敊璇殑Bug #2452
• 閲嶆瀯绯荤粺璁剧疆椤甸潰 #2545
• 淇搴旂敤绠＄悊椤甸潰锛屽綋 Flink 鍙傛暟鍊间负娴偣鏁版椂锛岄厤缃笉鐢熸晥鐨?Bug #2588
• 淇 Kubernetes Session 妯″紡涓嬶紝鏃犳棩蹇楄緭鍑虹殑 Bug #2599
• 淇浣滀笟澶辫触鐜囬娆＄浉鍏冲弬鏁伴厤缃敊璇殑 Bug #2668
• Kubernetes Ingress 澶氱増鏈€傞厤鏀寔 #2704

2.Release Note

鏈 StreamPark 2.1.0 鐗堟湰鐨?瀹屾暣 Release Note 璇疯闂細https://streampark.apache.org/download/release-note/2.1.0

3.鎰熻阿璐＄尞鑰?/h2>

StreamPark 寮€婧愮ぞ鍖虹殑鍙戝睍锛岀涓嶅紑骞垮ぇ鐢ㄦ埛缇や綋鐨勭Н鏋佸弽棣堝拰瀹ｄ紶甯冮亾锛屾洿绂讳笉寮€璐＄尞鑰呬滑鐨勬棤绉佽础鐚紝鎰熻阿瀵规鐗堟湰鍋氬嚭璐＄尞鐨勬瘡涓€浣嶈础鐚€呫€?/p>

鑷磋阿鍚嶅崟(鎺掑悕涓嶅垎鍏堝悗)锛?/p>

BIN銆丆hunFuWu銆丟avin銆丠aiYang Chen銆両nighty銆丣iabao Sun銆並ick156銆並illua銆丩eomax_Sun銆丳an Yuepeng銆丷oc Marshal銆乂ampireAchao銆乄SZ銆乥enjobs銆乧hengyuan銆乬ongzhongqiang銆乴vlin241銆乴vshaokang銆乵acksonmu銆乵onster銆乵zzx銆乻ober銆乼ison銆乼otoro銆亀jcwin銆亁ujiangfeng001銆亂unli銆亃hangxiangyang銆亃houlii

鐗瑰埆鎰熻阿鏈鐨?Release Manager @绌嗙函杩沎6]锛岀函杩涘湪鍙戠増鍓嶅仛浜嗗ぇ閲忔祴璇曞伐浣滐紝鏀堕泦 issue 鍙嶉锛屾湁鏁堢殑淇濊瘉浜嗙増鏈川閲忥紝鍙戠増杩囩▼涓Н鏋佺殑璺熻釜闂鍜屾帹杩涜繘搴︼紝瀹岀編鑳滀换浜嗘娆″彂鐗堝伐浣溿€傛劅璋㈢函杩涗负绀惧尯鍋氬嚭鐨勮础鐚紝涔熸杩庡叾浠?PPMC member 鍜?Committer 鍦ㄥ悗缁殑鍙戠増涓媴浠?Release Manager锛屽府鍔╃ぞ鍖烘洿蹇嵎銆侀珮璐ㄩ噺鍦板畬鎴愬彂鐗堛€?/p>

浠€涔堟槸StreamPark

StreamPark 鏄竴涓祦澶勭悊搴旂敤绋嬪簭寮€鍙戠鐞嗘鏋躲€傚垵琛锋槸璁╂祦澶勭悊鏇寸畝鍗曪紝鏃ㄥ湪杞绘澗鏋勫缓鍜岀鐞嗘祦澶勭悊搴旂敤绋嬪簭锛屾彁渚涗娇鐢?Apache Flink 鍜?Apache Spark 缂栧啓娴佸鐞嗗簲鐢ㄧ▼搴忕殑寮€鍙戞鏋讹紝鏈潵灏嗘敮鎸佹洿澶氬叾浠栧紩鎿庛€傚悓鏃讹紝StreamPark 鎻愪緵浜嗕竴涓祦澶勭悊搴旂敤绠＄悊骞冲彴锛屾牳蹇冭兘鍔涘寘鎷絾涓嶉檺浜庡簲鐢ㄥ紑鍙戙€佽皟璇曘€佷氦浜掓煡璇€侀儴缃层€佽繍缁淬€佸疄鏃舵暟浠撶瓑锛屾渶鍒濆紑婧愭椂椤圭洰鍚嶇О鍙?StreamX 锛屼簬 2022 骞?8 鏈堟洿鍚嶄负 StreamPark[7]锛岄殢鍚庨€氳繃鎶曠エ姝ｅ紡鎴愪负 Apache 寮€婧愯蒋浠跺熀閲戜細鐨勫鍖栭」鐩€?/p>

鍔犲叆鎴戜滑

StreamPark 绀惧尯涓€鐩翠互鏉ラ兘浠ョ敤蹇冨仛濂戒竴涓」鐩负鍘熷垯锛岄珮搴﹀叧娉ㄩ」鐩川閲忥紝鍔姏寤鸿鍙戝睍绀惧尯銆傚姞鍏?Apache 瀛靛寲鍣ㄤ互鏉ワ紝璁ょ湡瀛︿範鍜岄伒寰€孴he Apache Way銆嶏紝鎴戜滑灏嗙鎵挎洿鍔犲吋瀹瑰苟鍖呯殑蹇冩€侊紝杩庢帴鏇村鐨勬満閬囦笌鎸戞垬銆傝瘹鎸氭杩庢洿澶氱殑璐＄尞鑰呭弬涓庡埌绀惧尯寤鸿涓潵锛屽拰鎴戜滑涓€閬撴惡鎵嬪叡寤恒€?/p>

馃捇 椤圭洰鍦板潃锛歨ttps://github.com/apache/streampark
馃 鎻愪氦闂鍜屽缓璁細https://github.com/apache/streampark/issues
馃 璐＄尞浠ｇ爜锛歨ttps://github.com/apache/streampark/pulls
馃摦 Proposal锛歨ttps://cwiki.apache.org/confluence/display/INCUBATOR/StreamPark+Proposal
馃摟 璁㈤槄绀惧尯寮€鍙戦偖浠跺垪琛細dev@streampark.apache.org [8]

鍙傝€冭祫鏂?/strong>

[1] https://nightlies.apache.org/flink/flink-docs-release-1.17/release-notes/flink-1.17
[2] https://github.com/apache/streampark/pull/2582
[3] https://github.com/apache/streampark/pull/2615
[4] https://github.com/apache/streampark/pull/2375
[5] https://github.com/apache/streampark/pull/2317
[6] https://github.com/macksonmu
[7] https://github.com/apache/streampark/issues/1335
[8] mailto:dev@streampark.apache.org 绁濆ぇ瀹跺畨瑁呫€佸崌绾ч『鍒﹡~