What is giving a high score in the performance? What's giving a low score? That became Arushi’s next goal. And she started thinking about how even though like compared to sports like basketball, where success and failure of an action are pretty straightforward. But in figure skating, for the lay person it's very difficult: it seems like a very subjective scoring process. However, one of the original papers that had established this task actually said that judges have 96% agreement on these scores, despite it being subjective. How is that possible? “That comes from the use of rubrics,” Arushi reveals. “I was thinking, is there a way for me to utilize the rubrics that judges use to score these performances? Can this actually help the model? Can this help with interpretability? It's very minute things that lead to the quality score!” What Arushi did was to use the rubric information from the International Skating Union via what she calls the ‘Rubric Constrained Scoring Head’. Then, the next problem ends up being that the rubric is applied for technical element scoring, which is one big chunk of the figure skating score. It is applied for each element that is performed in the performance (like a jump, spin, step sequence, or a choreographic sequence), rather than transitions that are in-between elements. Because in between these elements, there are transitions where the skater is skating across the rink and dancing to the music. That's what makes it a whole performance. And that holistic score is another aspect of the scoring. “But that's not what I wanted to focus on,” Arushi objects. “I wanted to focus on something that was less subjective, like the technical score. We don't have these element segmentations. How can we use the rubric information? I proposed using 15 DAILY WACV Monday Rubric-Constrained Figure Skating Scoring
RkJQdWJsaXNoZXIy NTc3NzU=