天天看點

使用yarn api送出、監控spark任務

  • https://blog.csdn.net/camel84/article/details/81977766
  • 先建立擷取appID,然後把程式jar和依賴jar上傳到hdfs
    • http://localhost:8088/ws/v1/cluster/apps/new-application
    • http://localhost:50070/webhdfs/v1/spark-examples_2.11-2.3.1.jar?op=GETFILESTATUS
    • http://localhost:50070/webhdfs/v1/spark_libs.zip?op=GETFILESTATUS
  • 然後送出
    • http://localhost:8088/ws/v1/cluster/apps
  • 然後檢視
    • http://localhost:8088/ws/v1/cluster/apps/application_1534993174414_0001

繼續閱讀