-jm,--jobManagerMemory <arg> Memory for JobManager Container with
optional unit (default: MB)
-nm,--name Set a custom name for the application on
YARN
-q,--query Display available YARN resources (memory,
cores)
-qu,--queue <arg> Specify YARN queue.
-s,--slots <arg> Number of slots per TaskManager
-tm,--taskManagerMemory <arg> Memory per TaskManager Container with
optional unit (default: MB)
-z,--zookeeperNamespace <arg> Namespace to create the Zookeeper sub-
paths for HA mode
提交到yarn-cluster上需要以 y 或者yarn作为前缀;如: ynm=nm
flink run -c com.jacobs.jobs.realtime.wordcount.WindowWordCount target/real-
time-jobs-1.0.0-SNAPSHOT.jar
flink run -m yarn-cluster -ynm SinkToKafkaStream -yn 4 -yjm 1024m -ytm 4096m -
ys 4 -yqu feed.prod -c com.weibo.api.feed.dm.stream.TestFlinkStream /data1/dm-
flink/feed-dm-flink-1.0.4-SNAPSHOT.jar
flink run -m yarn-cluster -ynm SinkToKafkaStream -yn 2 -yjm 1024m -ytm 4096m -
ys 2 -yqu feed.prod -c com.weibo.api.feed.dm.stream.SinkToKafkaStream /data1/
dm-flink/feed-dm-flink-1.0.4-SNAPSHOT.jar
停任务
关闭或重启flink程序不能直接kill掉,这样会导致flink来不及制作checkpoint,应该调
flink提供的cancel语意
//重启正确姿势, with savepoint
1. 调cancel,cancel之前先触发savepoint
bin/flink cancel -s [:targetDirectory] :jobId -yid: yarnAppId
: flink cancel -s hdfs://vcp-yz-nameservice1/user/hcp/hcpsys/feed/flink-
checkpoints/test-user-logs 97b4e67859af4bfb1b597355f1c846f3 -yid
application_1542801635735_2121
2. 从savepoint中恢复flink程序