Team Members
Zeina Hesham Elbialy
Team Leader
Nader Amir Elhamy
Team Member
George Ayman Aziz
Team Member
Nouran Mohamed Sedky
Team Member
Supervisors
Dr. Salwa Osama
Professor
Eng. Nada Shorim
Senior Teaching Assistant
Abstract
The Automated Checking and Grading Tool is a Large Language model (LLM)-based system designed to assist university professors in evaluating Software Requirements Specification (SRS) and Software Design Description (SDD) documents. By leveraging a dataset of previously graded documents, the tool aims to provide consistent, objective assessments while significantly reducing manual effort. Using natural language processing (NLP) and Large Language Models (LLMs), the tool analyzes key aspects of documentation, such as clarity, completeness, adherence to business requirements, and proper use of design diagrams. Additionally, the system integrates a self-learning mechanism that continually improves its evaluation accuracy by incorporating feedback from professors. The final score combines the results of multiple evaluation criteria, delivering a detailed and fair assessment of each document’s quality. By automating this process, the tool improves grading consistency and reduces the workload for professors, allowing them to focus on higher-level tasks.
System Objectives
1. Automate Grading: Develop and implement an automated grading system for Software Requirements Specifications (SRS) and Software Design Descriptions (SDD) that can evaluate submissions based on predefined criteria, achieving at least 90% accuracy in grading within six months of deployment.
2. Provide Feedback: Create a feedback mechanism within the system that generates detailed, actionable feedback for each submission, allowing students to access their grades and feedback within 24 hours of submission, with professor approval.
3. Self-Learning Model: Integrate a self-learning algorithm that updates its grading criteria based on historical grading data and user feedback, resulting in a 20% improvement in grading consistency and accuracy over the first year of operation
System Scope
1. Development of an Automated Grading Tool: Create a software application that automates the grading of Software Requirements Specifications (SRS) and Software Design Descriptions (SDD) using Large Language Models (LLMs) to evaluate documents based on predefined criteria.
2. Focus on Technical Documentation: Specifically target the grading of SRS and SDD documents, addressing the unique challenges posed by technical content, including both textual and diagrammatic elements.
3. Continuous Learning and Improvement: Implement a self-learning mechanism that enables the grading model to evolve over time by learning from new data and feedback, enhancing its accuracy and effectiveness.
4. User Training and Support: Provide training and support for faculty members to effectively utilize the tool, ensuring they can interpret the results and feedback generated by the system.
5. Feedback Mechanism: Develop a robust feedback system that not only grades the documents but also provides detailed insights into areas of strength and opportunities for improvement.
6. Evaluation Criteria: Define clear evaluation criteria for the grading process, focusing on aspects such as completeness, clarity, adherence to business needs, and overall structure of the documentation.
7. Future Scalability: Design the system with scalability in mind, allowing it to be adapted for other types of academic documentation in the future.
Documents and Presentations
Proposal
You will find here the documents and presentation for our proposal.
TECHNICAL
You will find here the documents and presentation for our Technical.
Thesis
You will find here the documents and presentation for our Thesis
Document
Presentation
Accomplishments
Publications
Competitions
Competition Title
type here detailss about your participation in the competition.