In this report, we present a methodology to assess the evolution of AI technologies in the context of the AI WATCH initiative. The methodology is centred on building the AIcollaboratory, a data-driven framework to collect and explore data about AI results, progress and ultimately capabilities. From the collaborator framework we later extract qualitative information related to the state of the art, challenges and trends of AI research and development.
This report first describes the administrative context of study, followed by the proposed methodology to build the AIcollaboratory framework and exploit it for qualitative assessment. In addition, we present some preliminary results of this monitoring process and some conclusions and suggestions for future work.
This document is an internal report of the AI WATCH initiative, to be agreed for future work on Task 2 of the administrative arrangement between the Joint Research Centre and DG CNECT.JRC.B.6-Digital Econom
