- Apache Spark 2.x for Java Developers
- Sourav Gulati Sumit Kumar
- 242字
- 2021-07-02 19:02:02
Jobs
Jobs is the default tab of Spark UI. It shows the status of all the applications executed within a SparkContext. It can be accessed at http://localhost:4040/jobs/.
It consists of three sections:
- Active Jobs: This section is for the jobs that are currently running
- Completed Jobs: This section is for the jobs that successfully completed
- Failed Jobs: This section is for the jobs that were failed
It is shown in the following screenshot:
The Jobs tab section of Spark UI is rendered using the org.apache.spark.ui.jobs.JobsTab class that uses org.apache.spark.ui.jobs.JobProgressListener to get the statistics of the job.
After executing all the jobs mentioned in the Spark REPL also known as CLI section, Spark UI will look as follows:
Also, if you expand the Event Timeline section, you can see the time at which SparkContext started (that is, driver was initiated) and the jobs were executed along with their status:
Also, by clicking on any of the jobs, you can see the details of the job, that is, the Event Timeline of the job and the DAG of the transformations and stages executed during the execution of the job, as follows:
- Mastering QGIS
- Learn Scala Programming
- STM32F0實(shí)戰(zhàn)：基于HAL庫(kù)開(kāi)發(fā)
- Mastering ServiceNow（Second Edition）
- Visual FoxPro程序設(shè)計(jì)
- Java Web程序設(shè)計(jì)任務(wù)教程
- Python期貨量化交易實(shí)戰(zhàn)
- C語(yǔ)言程序設(shè)計(jì)教程
- Learning TypeScript
- Zend Framework 2 Cookbook
- Learning Rust
- SQL Server 2012數(shù)據(jù)庫(kù)管理與開(kāi)發(fā)（慕課版）
- Oracle API Management 12c Implementation
- ASP.NET 4權(quán)威指南
- Activiti權(quán)威指南