虎牙基于 Apache Iceberg + Amoro 在实时场景下的实践 #2
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
There was a problem hiding this comment.
现状需要突出用 Iceberg 遇到问题即抛出使用 Amoro 的动机？
There was a problem hiding this comment.
正文过三分之一，终于见着 Amoro 啦 -_-（建议有的放矢）
There was a problem hiding this comment.
建议标明场景一、二，衔接有点脱，或者就某一场景完整叙述，或者在摘要里点一下。
There was a problem hiding this comment.
-
场景二内容也是正文过半，才有了 Amoro；
-
整篇偏向于从虎牙角度讲述自己的完整实践过程，Amoro 为辅；作为社区用户案例最好突出
为什么用 Amoro。
There was a problem hiding this comment.
感觉这个代码没啥必要（不是关键代码），哈哈哈，简单说一下思路就好
There was a problem hiding this comment.
10分钟一次也是因为我们用watermark来进行判定了，感觉watermark可以提到前面来讲
There was a problem hiding this comment.
这里其实iceberg自己也有孤儿文件处理的action（spark）, 不过之前我们用离线的方式在每次进行合并之后进行调用都会扫描一次，这个成本有点高，用amoro其实是降低了成本的
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.