System Design Questions Roadmap

Design a system for job scheduling and execution to manage and automate the execution of tasks or jobs within a distributed computing environment. The system should allow users to define, schedule, and monitor the execution of jobs efficiently while considering factors such as resource allocation, task dependencies, fault tolerance, and scalability. Discuss how you would design a job scheduling service to receive job submissions, prioritize them based on various criteria, and allocate resources accordingly. Additionally, address how you would handle job dependencies, retries, and error handling to ensure job execution reliability. Provide insights into the technologies, scheduling algorithms, distributed computing frameworks, and monitoring tools you would employ to implement this job scheduling and execution system effectively.