Reviewing a markdown question#
This process specifically applies to .md files which will be converted to the PrairieLearn (PL) format and uploaded to PL, however many of the review processes are similar and applicable for other purposes.
Review Process#
If you have been requested to review a PR, make sure to click “Add your review”.
Comment or edit each line of the .md file as you see fit as part of your review
Check that the python syntax is correct.
This can be verified by adding the check_syntax label (hopefully the original author has already done this).
Check that the metadata is correctly filled out.
This includes title, topic, author, source, template_version, attribution, outcomes, difficulty, randomization, taxonomy, tags, and assets.
Check that the type for each part is correct.
For example, if there are multiple parts, each part may have a different “type” assignment.
Check that any randomization is sensible, and that the corner cases will not seem to cause issues.
For each question part, check that the format is correct and follows the most up to date syntax and organizational structure on the relevant template file.
Check that the problem works in PrairieLearn.
Be sure to pull from the git repo within PL to make sure you are viewing the latest problem version. For problems with randomization, you may need to do the problem multiple times to check all of the potential outcome branches.
Once your review is complete, submit your review with a comment which outlines what you have found and what needs to be done, if anything. If there are no issues, approve it. If there are issues, request changes before approval
Common Issues#
See the common issues page for some things to look for when you’re reviewing.