Quality Improvement Manuscript AI Grading and Suggestions Resources

This is a collection of resources and prompts for evaluating and grading student papers about quality improvement projects. It is broken down by sections as defined by SQUIRE 2.0 guidelines. https://www.squire-statement.org/index.cfm?fuseaction=Page.ViewPage&PageID=471 (You can watch a video overview of the SQUIRE 2.0 guidelines here. https://youtu.be/Z2wBDoks07c You can watch a video analysis of the rhetorical structure of the SQUIRE 2.0 guidelines here. https://youtu.be/40fvqNaJjl8) It is an extension of the general writing suggestions I provide in https://github.com/cmcntsh/PoWeRWritingGradStudents. (You can also watch this video where I go over some writing suggestions. https://youtu.be/0_M34HDC9f8) The generative models listed in the table below may work. I'm ordering the table by the models that currently seem the best for this purpose. Higher up the list seems to perform better, lower down the list may not perform as well or is untested. Models get updated periodically, so performance may vary over time.

| Link | Model | Company | Testing Status | Limitations | As of Date | | --- | --- | --- | --- | --- | --- | | https://chat.openai.com/ | GPT 3.5 | OpenAI | moderate testing | confused on more complex tasks | 01/31/2024 | | https://copilot.microsoft.com/ | GPT 4.0 Turbo | Microsoft | little testing | 2000 character input limit (need to split text up into chunks) | 01/31/2024 | | https://claude.ai/chats | Claude | Anthropic | little testing | | 01/31/2024 | | https://gemini.google.com/app | Gemini | Google | little testing | superficial analysis, minimal feedback on writing evaluation | 02/26/2024 | | https://chat.mistral.ai/chat | Mistral Large | Mistral | Untested | | 02/26/2024 |

Substantive Editing

Here is a prompt that analyzes text according to concepts in the reader expectation approach to writing described by George Gopen. You should evaluate each section of your paper using this prompt.

We are going to analyze this text according to the reader expectation approach to writing described by George Gopen. Gopen states that a paragraph should describe the issue of the paragraph in the first one to three sentences of the paragraph. Gopen also states that if the paragraph explicitly states a point, it should be stated as the last sentence of the issue or the last sentence of the discussion of the paragraph. For each paragraph, write out the paragraph. Then answer these questions about each paragraph. What is the issue of the paragraph? What is the paragraph about? Does the paragraph have a one-sentence, two-sentence, or three-sentence issue? What are the discussion points in the paragraph? Is each discussion point a good fit with the issue that has been identified for the paragraph? Is the ordering of discussion points logical? What is the point of the paragraph? Why was the paragraph written? Is the point of the paragraph explicitly stated, or is it implied? Is the paragraph a narrative paragraph that simply relays information so a point can be made later, or is the point of the paragraph explicitly stated in the paragraph? Does the point appear at the beginning of the paragraph or at the end? If the paragraph explicitly states a point, does the point appear at the last sentence of the issue or at the last sentence of the discussion, or somewhere else in the paragraph? Does the paragraph have a coda as the last sentence of the paragraph? Can you suggest any improvements to how the paragraph is structured? Is the ordering of the paragraphs logical? Can you suggest any improvements to how the paragraphs should be ordered? Next, analyze each sentence according to the concepts for sentence construction in the reader expectation approach described by Gopen. List each sentence and answer the following questions for the sentence. Does the sentence fit well with the issue for the paragraph in which the sentence resides? Does the sentence fit well with the discussion points in the paragraph in which the sentence resides? Which words in the sentence appear in the stress position just before a period, a colon, or a semicolon? What nominalizations are used in the sentence? What are the main actions expressed as verbs in the sentence? What is the main clause of the sentence? Does the main clause end with a period, colon, or semicolon? What is the grammatical subject of the main clause? Is there a qualifying clause or phrase in the sentence? What is the subject of the qualifying clause or phrase? Does the sentence have two main clauses separated by a comma? Is the subject and the verb separated by more than four words in the sentence? Does the sentence connect backward to the sentence that precedes it? If so, what is the connection? How close to the beginning of the sentence does the link to the previous sentence appear? Can you suggest any improvements to how the sentence is structured? Can you suggest any improvements to how the sentence links to the preceding sentence to improve flow? Here is the text: "<paste text here>"

Additional prompts for evaluating content and structure are provided in the individual sections below.

Copyediting

You should do copyediting (checking grammar, spelling, and punctuation) on the text in each section individually. https://github.com/cmcntsh/PoWeRWritingGradStudents?tab=readme-ov-file#preliminary-check-of-grammar-and-spelling-before-sending-your-work-to-others

Please list each sentence of this text in a new line, and please number the lines. In addition, please review each sentence for grammar, syntax, usage, spelling, and punctuation errors and suggest specific improvements. When suggesting revisions, please list the sentence number, the original sentence, the reason a revision might be needed, and then the revised sentence. If no revision is suggested, please indicate that no revision is needed. Here is the text: "[paste text here inside quotes]"

1. Title

Prompt: Evaluate the title of a quality improvement paper (See 1. Title at https://www.squire-statement.org/index.cfm?fuseaction=page.viewpage&pageid=504)

How well does this title meet the following criteria: Does the title indicate that it is about an initiative to improve safety, value, and/or quality in healthcare? Does the title describe the aim of the project? Does the title describe the context in which the project occurred? Is the title descriptive? Is the title simply written? Which terms in the title allow the reader to identify easily that the project is within the field of healthcare improvement? Which medical subject headings (MeSH) in the National Library of Medicine’s Medline database apply to this title? Please suggest ways the title could be improved and provide a revised title. Here is the title: "[paste the title here inside quotes]"

Grading the title using a specific rubric

Prompt

Please grade the following title based on this rubric. Here is the rubric: "[Paste the text of the rubric here, including the point values along the top and the grading categories along the side.]" Here is the title: "[Paste the title to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Title Categories | The title excellently conveys that it pertains to an initiative aimed at improving safety, value, and/or quality in healthcare. The aim of the project is succinctly and precisely described in the title, leaving no ambiguity about its purpose. The context in which the project occurred is thoroughly and clearly outlined, providing a comprehensive understanding of its background and setting. The title is exceptionally descriptive, effectively capturing the essence of the project's focus and objectives. The title is impeccably written, with simplicity and clarity that immediately resonate with readers, leaving a lasting impression. | The title effectively communicates that it relates to an initiative to enhance safety, value, and/or quality in healthcare. The aim of the project is clearly articulated in the title, providing a concise overview of its purpose. The context in which the project occurred is well-described, offering insight into its background and setting. The title is highly descriptive, conveying the project's focus and objectives with precision. The title is written in a clear and concise manner, facilitating immediate understanding. | The title reasonably indicates that it pertains to an initiative aimed at improving safety, value, and/or quality in healthcare. The aim of the project is briefly described in the title, providing a basic understanding of its purpose. The context in which the project occurred is mentioned to some extent, offering a general idea of its background. The title is descriptive enough to give readers a sense of the project's focus and objectives. The title is written in a straightforward manner, making it relatively easy to understand. | The title somewhat suggests an initiative to enhance safety, value, and/or quality in healthcare, but it lacks clarity. While the aim of the project may be hinted at, it is not fully described in the title. The context of the project is briefly mentioned but may not be clearly communicated. The title provides some description but could be more explicit and informative. The title may be somewhat convoluted or verbose, requiring effort to grasp its meaning. | The title fails to convey any indication that it relates to an initiative to improve safety, value, and/or quality in healthcare. The aim of the project and the context in which it occurred are not described in the title. The title lacks descriptiveness, providing little to no information about the project's focus or purpose. The title is overly complex or vague, making it difficult for readers to understand the project's essence. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make improvements and how they could be improved.

2. Abstract (write last)

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Grading the abstract using a specific rubric

Prompt

Please grade the following abstract based on this rubric. Here is the rubric: "[Paste the text of the abstract here, including the point values along the top and the grading categories along the side.]" Here is the title: "[Paste the title to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The abstract is exceptional in aiding searching and indexing, with highly relevant keywords and MeSH terms that capture the essence of the study. Key information from sections of the text is expertly summarized, providing a concise yet comprehensive overview of the study's local problem, methods, interventions, results, and conclusions. The abstract is impeccably structured and written, effectively conveying the significance and implications of the study in a succinct and compelling manner. | The abstract effectively aids in searching and indexing by providing comprehensive keywords and MeSH terms. Key information from sections of the text is succinctly and accurately summarized, offering a clear overview of the study. The abstract is well-structured and provides sufficient detail to convey the local problem, methods, interventions, results, and conclusions, facilitating understanding and evaluation. | The abstract includes adequate information for searching and indexing, with appropriate keywords and MeSH terms. Key information from sections of the text, including the local problem, methods, interventions, results, and conclusions, is summarized in a coherent manner. While the abstract provides a basic understanding of the study, there may be areas where more detail or clarity could improve comprehension. | The abstract provides some information for searching and indexing but lacks completeness. Keywords and MeSH terms are included, but they may not effectively capture the main concepts. Some key information from sections of the text is summarized, but there are gaps or inconsistencies in coverage. | The abstract lacks sufficient information to aid in searching and indexing. Keywords and MeSH terms are missing or poorly chosen, hindering discoverability. Essential information from sections of the text, such as the local problem, methods, interventions, results, and conclusions, is either entirely absent or inadequately summarized. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make improvements and how they could be improved.

3. Problem Description

Watch this short video description. https://youtu.be/BP-9dTvYsgU

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem or information that is simply not available at this point. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text answer each of these questions? Why are you doing this project? What is the problem you’re addressing? Who is affected? When is it a problem? Why does it matter? How does it affect the patient or system? Has a cause been identified? What will happen if this problem is not addressed? "[Paste the text you want evaluated here.]"

Prompt when text exceeds character limits

Prompt: Include this phrase instead of the text in the prompt above if the text is too long to submit in a single entry.

The text is long and I need to submit it in sections. Please tell me when you're ready for the first section of text. After you receive the first section of text, tell me when you're ready for the next section of text. After each submission, keep asking for the next section of text until I tell you I'm done submitting text. Don't analyze the text until after I tell you all the text is submitted.

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: "[Paste the text of the rubric here, including the point values along the top and the grading categories along the side.]" Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

4. Available Knowledge

Watch this video description. https://youtu.be/yILrA9n0Ihg You can also watch this video about evaluating evidence and scholarly literature. https://youtu.be/hfZaIqZH6qk This video demonstrates some AI literature search tools. https://youtu.be/MLSmrjunZMM

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem or information that is simply not available at this point. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

What evidence is cited in the following text to answer each of these questions? What is currently known about the problem in general, including relevant previous studies? Who is affected by the problem? What are the impacts of the problem? How does the problem affect those individuals? When is it a problem? Why is it a problem or why does the problem matter? What are the costs or the other negative impacts of the problem? How prevalent is the problem or how many people are affected? Are there any existing trends that contribute to the problem? Are probable causes of the problem identified? Are there any formal standards related to this problem? How are the main concepts relevant to the problem defined? Is any supporting literature or evidence cited? "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Supporting Evidence | Citations are expertly integrated into the text, seamlessly supporting each point made. Exceptionally strong supporting evidence is provided, exceeding section requirements. The relevance of the evidence to the project is clearly demonstrated, and the strength of the evidence significantly contributes to the overall quality and depth of the writing. | Citations are consistently used to support claims, with appropriate formatting. Strong supporting evidence is provided, demonstrating a clear understanding of section requirements. The relevance and strength of the evidence enhance the credibility and persuasiveness of the writing. | Citations are used appropriately when summarizing, paraphrasing, or quoting the ideas of others. Adequate supporting evidence is provided, meeting section requirements. The relevance of the evidence to the project is demonstrated, but it may lack depth. | Citations are used inconsistently or inappropriately. Some supporting evidence is provided, but it is insufficient or poorly integrated into the text. The relevance of the evidence to the project is unclear or weakly demonstrated. | The writing lacks citations or includes citations inconsistently. Supporting evidence is minimal or entirely absent. When citations are present, they are inappropriate or insufficient to support the points made. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. | | APA 7 Elements | Headings are expertly used to organize the document effectively, facilitating easy navigation and comprehension. In-text citations and references are flawless, meticulously adhering to APA 7 formatting guidelines. Tables, Figures, and Appendices are seamlessly integrated into the text, properly referenced, formatted, and located in exact accordance with APA 7 standards, demonstrating exemplary attention to detail and professionalism. | Headings are consistently used properly and formatted correctly, enhancing document clarity and structure. In-text citations and references are complete and accurately formatted according to APA 7 guidelines, with minimal errors. Tables, Figures, and Appendices are properly referenced, formatted, and located, adhering closely to APA 7 standards. | Headings are generally used properly and formatted correctly, aiding in document organization. In-text citations and references are mostly complete and formatted according to APA 7 standards, though some minor errors may be present. Tables, Figures, and Appendices are appropriately referenced, formatted, and located, generally following APA 7 guidelines. | Headings are inconsistently used or incorrectly formatted, leading to confusion. In-text citations and references are partially complete but contain errors in formatting or completeness. Tables, Figures, and Appendices are referenced and included, but there are some formatting or location issues that do not fully adhere to APA 7 guidelines. | Headings are missing or used incorrectly, hindering the organization of the document. In-text citations and references are either missing or incomplete, failing to adhere to APA 7 formatting guidelines. Tables, Figures, and Appendices are absent or improperly referenced, formatted, or located, violating APA 7 standards. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

5. Rationale

Watch this video description of how the Johns Hopkins Evidence-Based Practice Model may guide the activities of your project. https://youtu.be/KOkbnkKU-pk

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements? What frameworks, models, concepts, or theories are used to explain the problem? What frameworks, models, concepts, or theories were used to develop the intervention? What reasons or assumptions were used to develop the intervention? Why is the intervention expected to work? Describe the framework, model, or theory used to guide the activities of your project? Describe how the framework, model, or theory aligns with and guides the work on the project? Is any relevant literature cited? Is there any evidence this type of intervention may work? "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Supporting Evidence | Citations are expertly integrated into the text, seamlessly supporting each point made. Exceptionally strong supporting evidence is provided, exceeding section requirements. The relevance of the evidence to the project is clearly demonstrated, and the strength of the evidence significantly contributes to the overall quality and depth of the writing. | Citations are consistently used to support claims, with appropriate formatting. Strong supporting evidence is provided, demonstrating a clear understanding of section requirements. The relevance and strength of the evidence enhance the credibility and persuasiveness of the writing. | Citations are used appropriately when summarizing, paraphrasing, or quoting the ideas of others. Adequate supporting evidence is provided, meeting section requirements. The relevance of the evidence to the project is demonstrated, but it may lack depth. | Citations are used inconsistently or inappropriately. Some supporting evidence is provided, but it is insufficient or poorly integrated into the text. The relevance of the evidence to the project is unclear or weakly demonstrated. | The writing lacks citations or includes citations inconsistently. Supporting evidence is minimal or entirely absent. When citations are present, they are inappropriate or insufficient to support the points made. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. | | APA 7 Elements | Headings are expertly used to organize the document effectively, facilitating easy navigation and comprehension. In-text citations and references are flawless, meticulously adhering to APA 7 formatting guidelines. Tables, Figures, and Appendices are seamlessly integrated into the text, properly referenced, formatted, and located in exact accordance with APA 7 standards, demonstrating exemplary attention to detail and professionalism. | Headings are consistently used properly and formatted correctly, enhancing document clarity and structure. In-text citations and references are complete and accurately formatted according to APA 7 guidelines, with minimal errors. Tables, Figures, and Appendices are properly referenced, formatted, and located, adhering closely to APA 7 standards. | Headings are generally used properly and formatted correctly, aiding in document organization. In-text citations and references are mostly complete and formatted according to APA 7 standards, though some minor errors may be present. Tables, Figures, and Appendices are appropriately referenced, formatted, and located, generally following APA 7 guidelines. | Headings are inconsistently used or incorrectly formatted, leading to confusion. In-text citations and references are partially complete but contain errors in formatting or completeness. Tables, Figures, and Appendices are referenced and included, but there are some formatting or location issues that do not fully adhere to APA 7 guidelines. | Headings are missing or used incorrectly, hindering the organization of the document. In-text citations and references are either missing or incomplete, failing to adhere to APA 7 formatting guidelines. Tables, Figures, and Appendices are absent or improperly referenced, formatted, or located, violating APA 7 standards. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

6. Specific Aims

Watch this short video explanation https://youtu.be/3713oN5L-kU

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements? What is the purpose of the project? What are the objectives of the project? Do the objectives support the overall purpose? Are the objectives stated in a logical order? Are the project purpose and objectives clearly stated? "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: "[Paste the text of the rubric here, including the point values along the top and the grading categories along the side.]" Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

Grading objectives for SMART criteria using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: "[Paste the text of the rubric here, including the point values along the top and the grading categories along the side.]" Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | SMART Objectives | Objectives are impeccably specific, measurable, attainable, relevant, and time-based. Measurable criteria are quantifiable and easily understood, providing clear benchmarks for success. Objectives are not only attainable but also stretch goals that push the boundaries of achievement. Relevance to the project's goals and context is seamlessly integrated into the objectives. Timeframes for achieving the objectives are meticulously planned and aligned with project milestones, ensuring efficient progress and timely delivery. | Objectives are highly specific, leaving no room for ambiguity or misinterpretation. Measurable criteria are clearly defined, allowing for objective assessment of progress. Objectives are realistically attainable within the given resources and constraints. Relevance to the project's goals and context is well-established and articulated. Timeframes for achieving the objectives are precise and feasible, ensuring timely completion. | Objectives are specific enough to provide a clear understanding of what is to be achieved. Measurable criteria are defined to assess progress or success. Objectives are reasonably attainable given the resources and constraints. Relevance to the project's goals and context is adequately explained. Timeframes for achieving the objectives are provided, though they may need further clarification or adjustment. | Objectives are somewhat specific but lack clarity or detail. Some aspects of the objectives are measurable, but not all criteria are defined. Attainability of the objectives is questionable or depends on uncertain factors. Relevance to the project's goals is implied but not explicitly stated. Timeframes for achieving the objectives are mentioned but may lack precision or feasibility. | Objectives are vague and lack specificity, making it unclear what is to be achieved. There are no measurable criteria provided to assess progress or success. The objectives may be unrealistic or unattainable given the resources and constraints. Relevance to the overall goals or context of the project is unclear. Timeframes for achieving the objectives are absent or poorly defined. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

Problem-Evidence-Aim Alignment

Evaluate Problem Description and Objectives Alignment

Prompt: This prompt groups stated objectives with described problems.

I'm conducting a healthcare quality improvement project and reporting the results following SQUIRE 2.0 guidelines. Categorize how well the problem description text supports each project objective using the following categories. (available categories are directly supported, indirectly supported, and not supported) Here are the project objectives: "[paste project objectives text here]" Here is the problem description text: "[paste Problem Description text here]"

Evaluate Available Knowledge and Objectives Alignment

Prompt: This prompt groups stated objectives with described evidence.

I'm conducting a healthcare quality improvement project. Categorize how well the cited evidence supports each project objective using the following categories. (available categories are directly supported, indirectly supported, and not supported) Here are the project objectives: "[paste project objectives text here]" Here is the Available Knowledge text: "[paste Available Knowledge text here]"

Grading alignment using a specific rubric

Prompt: (Grading alignment may need to be done manually. This section may not lend itself to automatic grading, but the rubric may be useful for manual assessment.)

Please grade the following text based on this rubric. Here is the rubric: "[Paste the text of the rubric here, including the point values along the top and the grading categories along the side.]" Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Problem-Evidence-Aim Alignment | The stated objectives are exceptionally well-aligned with the problems described, illustrating a profound understanding of their interconnection. Objectives are precisely tailored to address the identified problems, leaving no doubt about their relevance and significance. Alignment between the objectives and the identified problems is flawless, reflecting a meticulous attention to detail and strategic planning. | The stated objectives directly address and align with the problems described, demonstrating a clear understanding of their relationship. Alignment between the objectives and the identified problems is evident and well-established. | The stated objectives generally align with the problems described, demonstrating a basic level of relevance. There is a reasonable connection between the objectives and the identified problems, though some aspects may require further clarification. Objectives are sufficiently specific to indicate their relevance to the identified problems, but there may be room for improvement in clarity and focus. | The stated objectives somewhat relate to the problems described but lack specificity or clarity. Alignment between the objectives and the identified problems is partially evident but may require refinement. Objectives are somewhat vague or broad, making it challenging to determine their direct relevance to the identified problems. | The stated objectives are irrelevant or unclear in addressing the problems described. There is a lack of alignment between the objectives and the identified problems. Objectives may be missing entirely or fail to address the core issues outlined. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

Project Deliverables (Work Breakdown Structure), Project Task List, Project Timeline

These aren't explicitly part of the SQUIRE guidelines, but defining these elements near the beginning of a project will help things run more smoothly. I'm including this material here for those working on projects while writing a QI paper.

Work Breakdown Structure (WBS) (or deliverables) Diagram

Watch this video explanation and demonstration. https://youtu.be/Wngwm4L8CLI

Project Task List and Timeline

Watch this video explanation and demonstration. https://youtu.be/vq06IElT-R4

7. Context

Watch this video explanation https://youtu.be/eyl_Y2VYarE

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements? What are the conditions that existed before the project started? What is the setting where the project is taking place? What processes were in use before the project started? Is this project part of a larger project? Who are the sponsors of the project? Who are the team members working on the project? Who are the beneficiaries of the project? Who will be directly impacted by the project? Who may be indirectly impacted by the project? Are there any contextual factors that may impact the success of the project? Is any literature or supporting evidence cited? "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Supporting Evidence | Citations are expertly integrated into the text, seamlessly supporting each point made. Exceptionally strong supporting evidence is provided, exceeding section requirements. The relevance of the evidence to the project is clearly demonstrated, and the strength of the evidence significantly contributes to the overall quality and depth of the writing. | Citations are consistently used to support claims, with appropriate formatting. Strong supporting evidence is provided, demonstrating a clear understanding of section requirements. The relevance and strength of the evidence enhance the credibility and persuasiveness of the writing. | Citations are used appropriately when summarizing, paraphrasing, or quoting the ideas of others. Adequate supporting evidence is provided, meeting section requirements. The relevance of the evidence to the project is demonstrated, but it may lack depth. | Citations are used inconsistently or inappropriately. Some supporting evidence is provided, but it is insufficient or poorly integrated into the text. The relevance of the evidence to the project is unclear or weakly demonstrated. | The writing lacks citations or includes citations inconsistently. Supporting evidence is minimal or entirely absent. When citations are present, they are inappropriate or insufficient to support the points made. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. | | APA 7 Elements | Headings are expertly used to organize the document effectively, facilitating easy navigation and comprehension. In-text citations and references are flawless, meticulously adhering to APA 7 formatting guidelines. Tables, Figures, and Appendices are seamlessly integrated into the text, properly referenced, formatted, and located in exact accordance with APA 7 standards, demonstrating exemplary attention to detail and professionalism. | Headings are consistently used properly and formatted correctly, enhancing document clarity and structure. In-text citations and references are complete and accurately formatted according to APA 7 guidelines, with minimal errors. Tables, Figures, and Appendices are properly referenced, formatted, and located, adhering closely to APA 7 standards. | Headings are generally used properly and formatted correctly, aiding in document organization. In-text citations and references are mostly complete and formatted according to APA 7 standards, though some minor errors may be present. Tables, Figures, and Appendices are appropriately referenced, formatted, and located, generally following APA 7 guidelines. | Headings are inconsistently used or incorrectly formatted, leading to confusion. In-text citations and references are partially complete but contain errors in formatting or completeness. Tables, Figures, and Appendices are referenced and included, but there are some formatting or location issues that do not fully adhere to APA 7 guidelines. | Headings are missing or used incorrectly, hindering the organization of the document. In-text citations and references are either missing or incomplete, failing to adhere to APA 7 formatting guidelines. Tables, Figures, and Appendices are absent or improperly referenced, formatted, or located, violating APA 7 standards. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

8. Intervention(s)

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements for each project objective? What is the name of the intervention? What is the rationale or theory behind the intervention? What materials were used for the intervention or training given to those who delivered the intervention? What procedures, activities, or processes were used in the intervention? Who delivered the intervention? What was their expertise or background? Describe the mode of delivery of the intervention. Describe the location of where the intervention was delivered, including any necessary infrastructure. When was the intervention delivered and how often? Was the intervention tailored to any specific individuals? If so describe how. Was the intervention modified during the course of the study? If so, describe how. Describe the extent to which the intervention was delivered as planned. Here are the project objectives: "[Paste text describing each objective here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. | | APA 7 Elements | Headings are expertly used to organize the document effectively, facilitating easy navigation and comprehension. In-text citations and references are flawless, meticulously adhering to APA 7 formatting guidelines. Tables, Figures, and Appendices are seamlessly integrated into the text, properly referenced, formatted, and located in exact accordance with APA 7 standards, demonstrating exemplary attention to detail and professionalism. | Headings are consistently used properly and formatted correctly, enhancing document clarity and structure. In-text citations and references are complete and accurately formatted according to APA 7 guidelines, with minimal errors. Tables, Figures, and Appendices are properly referenced, formatted, and located, adhering closely to APA 7 standards. | Headings are generally used properly and formatted correctly, aiding in document organization. In-text citations and references are mostly complete and formatted according to APA 7 standards, though some minor errors may be present. Tables, Figures, and Appendices are appropriately referenced, formatted, and located, generally following APA 7 guidelines. | Headings are inconsistently used or incorrectly formatted, leading to confusion. In-text citations and references are partially complete but contain errors in formatting or completeness. Tables, Figures, and Appendices are referenced and included, but there are some formatting or location issues that do not fully adhere to APA 7 guidelines. | Headings are missing or used incorrectly, hindering the organization of the document. In-text citations and references are either missing or incomplete, failing to adhere to APA 7 formatting guidelines. Tables, Figures, and Appendices are absent or improperly referenced, formatted, or located, violating APA 7 standards. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

9. Study of the Intervention(s)

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements for each project objective? What approach will be used to evaluate the effectiveness of the intervention? What approach will be used to establish whether the outcomes were due to the intervention? Here are the project objectives: "[Paste text describing each objective here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. | | APA 7 Elements | Headings are expertly used to organize the document effectively, facilitating easy navigation and comprehension. In-text citations and references are flawless, meticulously adhering to APA 7 formatting guidelines. Tables, Figures, and Appendices are seamlessly integrated into the text, properly referenced, formatted, and located in exact accordance with APA 7 standards, demonstrating exemplary attention to detail and professionalism. | Headings are consistently used properly and formatted correctly, enhancing document clarity and structure. In-text citations and references are complete and accurately formatted according to APA 7 guidelines, with minimal errors. Tables, Figures, and Appendices are properly referenced, formatted, and located, adhering closely to APA 7 standards. | Headings are generally used properly and formatted correctly, aiding in document organization. In-text citations and references are mostly complete and formatted according to APA 7 standards, though some minor errors may be present. Tables, Figures, and Appendices are appropriately referenced, formatted, and located, generally following APA 7 guidelines. | Headings are inconsistently used or incorrectly formatted, leading to confusion. In-text citations and references are partially complete but contain errors in formatting or completeness. Tables, Figures, and Appendices are referenced and included, but there are some formatting or location issues that do not fully adhere to APA 7 guidelines. | Headings are missing or used incorrectly, hindering the organization of the document. In-text citations and references are either missing or incomplete, failing to adhere to APA 7 formatting guidelines. Tables, Figures, and Appendices are absent or improperly referenced, formatted, or located, violating APA 7 standards. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

10. Measures

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements for each project objective? What tools, instruments, or measures are described? What are the operational definitions for key concepts? What is the reliability and validity of the tools, instruments, or measures? What is the approach for assessing contextual elements that impact the success or failure of the intervention? What methods to assess the completeness and accuracy of the data are described? Here are the project objectives: "[Paste text describing each objective here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Supporting Evidence | Citations are expertly integrated into the text, seamlessly supporting each point made. Exceptionally strong supporting evidence is provided, exceeding section requirements. The relevance of the evidence to the project is clearly demonstrated, and the strength of the evidence significantly contributes to the overall quality and depth of the writing. | Citations are consistently used to support claims, with appropriate formatting. Strong supporting evidence is provided, demonstrating a clear understanding of section requirements. The relevance and strength of the evidence enhance the credibility and persuasiveness of the writing. | Citations are used appropriately when summarizing, paraphrasing, or quoting the ideas of others. Adequate supporting evidence is provided, meeting section requirements. The relevance of the evidence to the project is demonstrated, but it may lack depth. | Citations are used inconsistently or inappropriately. Some supporting evidence is provided, but it is insufficient or poorly integrated into the text. The relevance of the evidence to the project is unclear or weakly demonstrated. | The writing lacks citations or includes citations inconsistently. Supporting evidence is minimal or entirely absent. When citations are present, they are inappropriate or insufficient to support the points made. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. | | APA 7 Elements | Headings are expertly used to organize the document effectively, facilitating easy navigation and comprehension. In-text citations and references are flawless, meticulously adhering to APA 7 formatting guidelines. Tables, Figures, and Appendices are seamlessly integrated into the text, properly referenced, formatted, and located in exact accordance with APA 7 standards, demonstrating exemplary attention to detail and professionalism. | Headings are consistently used properly and formatted correctly, enhancing document clarity and structure. In-text citations and references are complete and accurately formatted according to APA 7 guidelines, with minimal errors. Tables, Figures, and Appendices are properly referenced, formatted, and located, adhering closely to APA 7 standards. | Headings are generally used properly and formatted correctly, aiding in document organization. In-text citations and references are mostly complete and formatted according to APA 7 standards, though some minor errors may be present. Tables, Figures, and Appendices are appropriately referenced, formatted, and located, generally following APA 7 guidelines. | Headings are inconsistently used or incorrectly formatted, leading to confusion. In-text citations and references are partially complete but contain errors in formatting or completeness. Tables, Figures, and Appendices are referenced and included, but there are some formatting or location issues that do not fully adhere to APA 7 guidelines. | Headings are missing or used incorrectly, hindering the organization of the document. In-text citations and references are either missing or incomplete, failing to adhere to APA 7 formatting guidelines. Tables, Figures, and Appendices are absent or improperly referenced, formatted, or located, violating APA 7 standards. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

11. Analysis

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements for each project objective? What qualitative methods are described to draw inferences from the data? What quantitative methods are described to draw inferences from the data? Here are the project objectives: "[Paste text describing each objective here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

Intervention(s)-Study-Measure-Analysis Alignment

Watch this video explanation. https://youtu.be/UYBu_LRZEd8

Evaluate Study of the Interventions(s) and Intervention(s) Alignment

Prompt: This prompt groups Study of the Intervention(s) with described interventions.

How well does the following text discuss ways to assess each project intervention? Please list the full description for each intervention and explain what approach will be used to evaluate the effectiveness of the intervention? In addition, describe what approach will be used to establish whether the outcomes were due to the intervention. Here are the project interventions: "[Paste text describing each intervention here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Evaluate Measure and Intervention(s) Alignment

Prompt: This prompt groups measures with described interventions.

How well does the following text discuss each of these elements for each project intervention? What tools, instruments, or measures are described? What are the operational definitions for key concepts? What is the reliability and validity of the tools, instruments, or measures? What is the approach for assessing contextual elements that impact the success or failure of the intervention? What methods to assess the completeness and accuracy of the data are described? Please list the full description for each intervention and then provide your analysis. Here are the project interventions: "[Paste text describing each intervention here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Evaluate Analysis and Intervention(s) Alignment

Prompt: This prompt groups analyses with described interventions.

How well does the following text report an outcome for each project intervention? What qualitative methods are described to draw inferences from the data? What quantitative methods are described to draw inferences from the data? Please list the full description for each intervention and then provide your analysis for each intervention. Here are the project interventions: "[Paste text describing each intervention here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Grading alignment using a specific rubric

Prompt: (Grading alignment may need to be done manually. This section may not lend itself to automatic grading, but the rubric may be useful for manual assessment.)

Please grade the following text based on this rubric. Here is the rubric: "[Paste the text of the rubric here, including the point values along the top and the grading categories along the side.]" Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Intervention-Study-Measure-Analysis Alignment | The outlined interventions are impeccably addressed by the Study, Measure, and Analysis descriptions, exhibiting flawless alignment. There is perfect coherence between the interventions outlined and how they are addressed in the Study, Measure, and Analysis sections. The descriptions of the Study, Measure, and Analysis are highly detailed and meticulously crafted, providing an in-depth understanding of how the interventions are implemented and evaluated. | The outlined interventions are effectively addressed by the Study, Measure, and Analysis descriptions, demonstrating a clear alignment. There is a strong coherence between the interventions outlined and how they are addressed in the Study, Measure, and Analysis sections. The descriptions of the Study, Measure, and Analysis provide detailed information on the implementation and evaluation of the interventions, ensuring comprehensive coverage. | The outlined interventions are generally addressed by the Study, Measure, and Analysis descriptions, providing a basic level of alignment. There is some coherence between the interventions outlined and how they are addressed in the Study, Measure, and Analysis sections. The descriptions of the Study, Measure, and Analysis provide sufficient detail to understand how the interventions are implemented and evaluated. | Some of the outlined interventions are addressed by the Study, Measure, and Analysis descriptions, but there are gaps or inconsistencies. The alignment between interventions and their treatment in the Study, Measure, and Analysis sections is partially evident but needs improvement. The descriptions of the Study, Measure, and Analysis lack specificity or depth in addressing the outlined interventions. | The outlined interventions are not addressed or are poorly addressed by the Study, Measure, and Analysis descriptions. There is a lack of coherence between the interventions outlined and how they are addressed in the Study, Measure, and Analysis sections. The Study, Measure, and Analysis descriptions fail to provide sufficient detail or clarity regarding the interventions. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

12. Ethical Considerations

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements? What ethical review process is described? What conflicts of interest are described? What are the ethical aspects particular to this project? Is any literature or evidence cited? "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Supporting Evidence | Citations are expertly integrated into the text, seamlessly supporting each point made. Exceptionally strong supporting evidence is provided, exceeding section requirements. The relevance of the evidence to the project is clearly demonstrated, and the strength of the evidence significantly contributes to the overall quality and depth of the writing. | Citations are consistently used to support claims, with appropriate formatting. Strong supporting evidence is provided, demonstrating a clear understanding of section requirements. The relevance and strength of the evidence enhance the credibility and persuasiveness of the writing. | Citations are used appropriately when summarizing, paraphrasing, or quoting the ideas of others. Adequate supporting evidence is provided, meeting section requirements. The relevance of the evidence to the project is demonstrated, but it may lack depth. | Citations are used inconsistently or inappropriately. Some supporting evidence is provided, but it is insufficient or poorly integrated into the text. The relevance of the evidence to the project is unclear or weakly demonstrated. | The writing lacks citations or includes citations inconsistently. Supporting evidence is minimal or entirely absent. When citations are present, they are inappropriate or insufficient to support the points made. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

13. Results

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements for each project objective? What were the steps to implement the project? Did the project go as planned? What were the results? What was measured? Were there any unintended consequences? Is missing data or any other data quality issues described? Here are the project objectives: "[Paste text describing each objective here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Supporting Evidence | Exceptionally strong supporting evidence is provided, exceeding section requirements. The relevance of the evidence to the project is clearly demonstrated, and the strength of the evidence significantly contributes to the overall quality and depth of the writing. | Strong supporting evidence is provided, demonstrating a clear understanding of section requirements. The relevance and strength of the evidence enhance the credibility and persuasiveness of the writing. | Adequate supporting evidence is provided, meeting section requirements. The relevance of the evidence to the project is demonstrated, but it may lack depth. | Some supporting evidence is provided, but it is insufficient or poorly integrated into the text. The relevance of the evidence to the project is unclear or weakly demonstrated. | Supporting evidence is minimal, entirely absent, or inappropriate to support the points made. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. | | APA 7 Elements | Headings are expertly used to organize the document effectively, facilitating easy navigation and comprehension. In-text citations and references are flawless, meticulously adhering to APA 7 formatting guidelines. Tables, Figures, and Appendices are seamlessly integrated into the text, properly referenced, formatted, and located in exact accordance with APA 7 standards, demonstrating exemplary attention to detail and professionalism. | Headings are consistently used properly and formatted correctly, enhancing document clarity and structure. In-text citations and references are complete and accurately formatted according to APA 7 guidelines, with minimal errors. Tables, Figures, and Appendices are properly referenced, formatted, and located, adhering closely to APA 7 standards. | Headings are generally used properly and formatted correctly, aiding in document organization. In-text citations and references are mostly complete and formatted according to APA 7 standards, though some minor errors may be present. Tables, Figures, and Appendices are appropriately referenced, formatted, and located, generally following APA 7 guidelines. | Headings are inconsistently used or incorrectly formatted, leading to confusion. In-text citations and references are partially complete but contain errors in formatting or completeness. Tables, Figures, and Appendices are referenced and included, but there are some formatting or location issues that do not fully adhere to APA 7 guidelines. | Headings are missing or used incorrectly, hindering the organization of the document. In-text citations and references are either missing or incomplete, failing to adhere to APA 7 formatting guidelines. Tables, Figures, and Appendices are absent or improperly referenced, formatted, or located, violating APA 7 standards. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

14. Summary

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements for each project objective? What were key findings for the project? Which results were most compelling? What is the link between key findings and project objectives? Here are the project objectives: "[Paste text describing each objective here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

15. Interpretation

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements for each project objective? How do the results of this project compare with results of other publications? What was the impact of the project on people or systems? What were the reasons for any differences between observed and anticipated outcomes? Did the project accomplish the stated purposes? What lessons were learned by conducting the project? What pitfalls or challenges were encountered during the project? What solutions were found to overcome the challenges? Is any literature or evidence cited? Here are the project objectives: "[Paste text describing each objective here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

16. Limitations

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements for each project objective? What are the limitations to the generalizability of the work? What factors may limit internal validity? What are the limitations of the project? What efforts were made to adjust for limitations? Here are the project objectives: "[Paste text describing each objective here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

17. Conclusions

Get a quick overall understanding of what is covered in the section by getting an outline

Prompt

Please display the following text in outline format. In addition, please make the level 1 headings bold. In addition, please make the level 2 headings italics. Here is the text: "[paste text here inside quotes]"

Copyediting

See copyediting prompt above. https://github.com/cmcntsh/QualImpAIGrading#copyediting

Evaluate the Comprehensiveness of Content Coverage

This section should cover most of the aspects described in the section instructions unless there are elements that are not relevant to this particular problem. I would assess the comprehensiveness of the student's writing and identify any gaps left unaddressed by the student, and assign a grade according to the point rubric accordingly.

Prompt: This is the substantive editing prompt that evaluates general content.

How well does the following text discuss each of these elements for each project objective? What is the usefulness of the work? Is the work sustainable? What is the potential to spread this work to other contexts? What are the implications for practice? What are the implications for further study in the field? What is the overall usefulness of the work done for this project? Are there any larger implications to the field beyond this local setting? What else might still need to be done? What are the next steps? Are there any areas where current literature does not address questions you had or issues you encountered? Here are the project objectives: "[Paste text describing each objective here.]" Here is the section text: "[Paste the text you want evaluated here.]"

Grading a piece of writing using a specific rubric

Prompt

Please grade the following text based on this rubric. Here is the rubric: [Paste the text of the rubric here, including the point values along the top and the grading categories along the side.] Here is the text: "[Paste the text to be graded here inside quotes.]"

Rubric

| Criteria | 5 | 4 | 3 | 2 | 1 | | --- | --- | --- | --- | --- | --- | | Content Coverage | The writing surpasses expectations by providing comprehensive coverage of topics. The content is highly relevant, insightful, and demonstrates a deep understanding. | The writing thoroughly covers all required topics, demonstrating a clear understanding of section requirements. | The writing adequately covers the required topics according to section requirements. Relevant information is provided, demonstrating a basic understanding of the project's objectives. The coverage may lack depth or originality but meets the minimum expectations for completeness. | The writing partially covers the required topics but lacks depth or clarity. Some relevant information is included, but there are gaps in understanding or analysis. | The writing lacks coherence and fails to address the required topics. There is a significant amount of irrelevant information or omission of crucial points. | | Sentences | Sentences are flawless in terms of spelling, grammar, punctuation, and syntax. Each sentence is crafted with precision, clarity, and conciseness, maximizing readability. The writing flows smoothly, and the impeccable sentence structure enhances the overall effectiveness and professionalism of the text. | Sentences exhibit strong spelling, grammar, punctuation, and syntax, enhancing readability. Clear and concise sentences effectively convey ideas with precision and coherence. Errors, if any, are minimal and do not distract from the overall quality of writing. | Sentences demonstrate basic proficiency in spelling, grammar, punctuation, and syntax. Most sentences are clear and reasonably concise, facilitating understanding. Minor errors may still occur but do not significantly impede comprehension. | Spelling, grammar, and punctuation errors are present but do not overly detract from understanding. Some sentences may be unclear or awkwardly constructed, requiring effort to decipher. Overall, sentences lack conciseness and may contain unnecessary words or phrases. | Numerous spelling errors, grammar mistakes, and punctuation errors hinder comprehension. The syntax is convoluted, making sentences difficult to follow. Sentences lack clarity and conciseness, leading to confusion or ambiguity. | | Paragraphs | Paragraphs exhibit exceptional clarity and precision in presenting a single main topic or theme. Sentences within paragraphs are seamlessly connected, creating a coherent and compelling narrative. Transitions between sentences are expertly executed, guiding the reader effortlessly through the progression of ideas and ensuring a seamless flow of thought. | Paragraphs clearly establish a single main topic or theme, providing focus and clarity. Sentences within paragraphs flow smoothly, with logical progression of ideas. Transitions between sentences are well-crafted, enhancing the coherence and unity of the paragraph. | Paragraphs generally maintain a single main topic or theme throughout. Sentences within paragraphs are logically sequenced, facilitating understanding. Transitions between sentences are adequate, helping to maintain coherence and flow within the paragraph. | Paragraphs attempt to establish a main topic, but it may be vague or inconsistently maintained. Sentences within paragraphs are somewhat related but lack a cohesive structure. Transitions between sentences are present but may be clumsy or ineffective, causing some disruption in the flow of ideas. | Paragraphs lack a clear main topic or focus, leading to confusion. Sentences within paragraphs are disjointed, lacking coherence and logical sequence. Transitions between sentences are absent or abrupt, hindering the flow of ideas. | | Overall Organization and Flow | The material demonstrates exceptional organization and coherence within the section. Paragraphs are meticulously ordered and seamlessly connected, creating a cohesive and engaging narrative. Transitions between paragraphs are expertly crafted, facilitating a smooth and effortless flow of ideas throughout the section. | The material is well-organized and effectively structured for the section. Paragraphs flow logically from one to the next, with clear and effective transitions. The overall flow of the section is smooth and coherent, guiding the reader through the content in a logical and comprehensible manner. | The material is generally organized appropriately for the section, with a discernible structure. Paragraphs are ordered logically, and transitions between them are generally smooth. While the flow of the section is generally coherent, there may be some minor inconsistencies or disruptions. | The material shows some attempt at organization, but it is inconsistent or unclear. Paragraphs may have a loose logical order, but the transitions between them are often awkward or abrupt. The overall flow of the section is disrupted, making it challenging for the reader to follow the intended progression of ideas. | The material is disorganized and lacks coherence within the section. Paragraphs are randomly ordered or unrelated to the section's content. Transitions between paragraphs are absent or ineffective, resulting in a disjointed and confusing reading experience. |

Follow up to get specific suggestions for improvement

ChatGPT suggested a grade and made some geneneral suggestions for improvement. I followed up with another prompt and received specific examples with suggested fixes.

Prompt

Please provide specific examples where the author could make corrections and how they could be corrected.

References

Prompt: Check the formatting of references in the references list. (These need to be double-checked to verify correctness, but this prompt caught many formatting problems.)

Do these references follow proper APA 7 formatting guidelines? Please suggest specific improvements where needed. Here are the references: "[paste references here in quotes]"

Prompt: Match citations used in the body of the paper to references in the reference list. Identify citations missing a reference and references missing a citation.

Here is a piece of text and a reference list that is supposed to be formatted to APA 7 standards. Please list each sentence in the text that includes a parenthetical or in-text citation and the reference in the reference list that matches each citation. After listing the sentences that use citations, please list each reference in the reference list that is not cited in the text. Here is the text: "<paste text here>" Here is the reference list: "<paste reference list here>"

Areas of Difficulty During Final Review Process

• All parts of the project that have been completed should be referred to in the past tense in all parts of the paper. (If you're fairly certain a part of the project will be complete by the time you're finishing your paper, it's perfectly acceptable to write about it in the past tense during earlier stages of writing.)
• All spelling, grammar, and punctuation errors need to be corrected. (Those are highlighted in red in Grammarly.)
• The review process will go much more smoothly and quickly if you edit your paper for clarity and conciseness. (Those suggestions are highlighted in blue in Grammarly.)
• Tables and Figures need to follow APA formatting standards.
  • https://apastyle.apa.org/style-grammar-guidelines/tables-figures/tables
  • https://apastyle.apa.org/style-grammar-guidelines/tables-figures/figures
  • APA 7 in Microsoft Word: Formatting Tables (14 min) https://www.youtube.com/watch?v=s8rS4uL6jVI
• Abbreviations should be defined the first time they're used in the paper. Thereafter, only the abbreviation should be used in the paper, and not the original term.
  • https://apastyle.apa.org/style-grammar-guidelines/abbreviations/definition#:~:text=If%20an%20abbreviation%20has%20appeared,the%20term%20and%20abbreviating%20it.