I put together this grading rubric based on this paper published to the World Economic Forum (terrible name, I know). The idea for this rubric is you should have a checklist of some sort where you can see exactly how you’re doing in terms of responsibly building an AI system. It’s deliberately meant to be difficult to build something that has green across the board so I would suspect most projects out there to not grade very well on it.
However, most of these papers being published on AI have similar requirements for something they would consider “good” so I think an actionable grading rubric such as this is a good start for evaluating where you are at.
You can find the grading rubric on this Google Docs link. Have any feedback? I’d love to hear it here. Especially if there’s something you feel is missing!