Multi-evaluatie in ruimtelijke planning: de toepassing in een Vlaamse case

Ruimtelijke ontwikkelingen worden steeds meer dynamisch, a-lineair en complex met een breed speelveld van mogelijke actoren. Het besef van onzekerheid wordt groter en het inbouwen van meer flexibiliteit in het planningsproces wordt noodzakelijk. Maar tegelijkertijd is er een groeiende vraag naar beter onderbouwde en weloverwogen beslissingen. Ervaringen uit het verleden kunnen steeds minder geëxtrapoleerd worden naar de toekomst en modelleringen verliezen hun geloofwaardigheid of worden steeds minder aanvaard. Hoe kunnen we ruimte laten voor flexibiliteit in langdurige, multi-actor projecten die continu veranderen en ze toch op het juiste spoor houden? Dit vraagt om een meer geïntegreerde, complementaire en accurate maar tegelijk dynamische evaluatie in de ruimtelijke planning, die kan mee-evolueren met de huidige processen en dynamieken. De reguliere, rationele evaluatiehoudingen hebben een lage flexibiliteit en zijn te lineair om zich aan de huidige multicausale ruimtelijke ontwikkelingen te kunnen aanpassen. Daarom introduceert dit artikel een evaluatiemethodologie die verder gaat. Deze meervoudige evaluatiebenadering varieert naargelang het object van de evaluatie en de bijhorende context. Vervolgens wordt dit theoretisch kader vertaald naar een specifieke casestudie. Deze case illustreert de huidige ruimtelijke ontwikkelingen en een mogelijke evaluatiebenadering, geïntegreerd vanaf het begin van het proces, om dit soort projecten te begeleiden

On the right track? : evaluation as a tool to guide spatial transitions

Spatial developments are becoming more and more non-linear, dynamic and complex with a wide range of possible actors. The awareness of uncertainty in spatial planning is growing and therefore, projects need to integrate a high level of flexibility. But at the same time, a growing demand for taking more informed and well-argued decisions is noticeable. Predictions out of the ‘best estimated model’ are no longer credible and no longer accepted, because they are too fragile and uncertain. How can we keep these long-lasting, multi-actor projects in permanent transition on the right track? This article presents an evaluation methodology that goes beyond the traditional, rational evaluation attitudes with a low level of flexibility being too linear to match the current spatial developments. There is a need for more interrelated, alert and flexible means of evaluation, co-evolving with the processes and current dynamics in spatial planning. Therefore, different evaluation approaches are introduced, depending on the specific interdependencies of the object of evaluation and its context. Subsequently, the theoretical framework is translated towards a more practical level. A case study conducted in Flanders illustrates the current spatial developments and a possible evaluation approach, incorporated from the beginning of the process, to guide this kind of projects

In no uncertain terms : a dataset for monolingual and multilingual automatic term extraction from comparable corpora

Automatic term extraction is a productive field of research within natural language processing, but it still faces significant obstacles regarding datasets and evaluation, which require manual term annotation. This is an arduous task, made even more difficult by the lack of a clear distinction between terms and general language, which results in low inter-annotator agreement. There is a large need for well-documented, manually validated datasets, especially in the rising field of multilingual term extraction from comparable corpora, which presents a unique new set of challenges. In this paper, a new approach is presented for both monolingual and multilingual term annotation in comparable corpora. The detailed guidelines with different term labels, the domain- and language-independent methodology and the large volumes annotated in three different languages and four different domains make this a rich resource. The resulting datasets are not just suited for evaluation purposes but can also serve as a general source of information about terms and even as training data for supervised methods. Moreover, the gold standard for multilingual term extraction from comparable corpora contains information about term variants and translation equivalents, which allows an in-depth, nuanced evaluation

Dutch hypernym detection : does decompounding help?

This research presents experiments carried out to improve the precision and recall of Dutch hypernym detection. To do so, we applied a data-driven semantic relation finder that starts from a list of automatically extracted domain-specific terms from technical corpora, and generates a list of hypernym relations between these terms. As Dutch technical terms often consist of compounds written in one orthographic unit, we investigated the impact of a decompounding module on the performance of the hypernym detection system. In addition, we also improved the precision of the system by designing filters taking into account statistical and linguistic information. The experimental results show that both the precision and recall of the hypernym detection system improved, and that the decompounding module is especially effective for hypernym detection in Dutch

TermEval 2020 : shared task on automatic term extraction using the Annotated Corpora for term Extraction Research (ACTER) dataset

The TermEval 2020 shared task provided a platform for researchers to work on automatic term extraction (ATE) with the same dataset: the Annotated Corpora for Term Extraction Research (ACTER). The dataset covers three languages (English, French, and Dutch) and four domains, of which the domain of heart failure was kept as a held-out test set on which final f1-scores were calculated. The aim was to provide a large, transparent, qualitatively annotated, and diverse dataset to the ATE research community, with the goal of promoting comparative research and thus identifying strengths and weaknesses of various state-of-the-art methodologies. The results show a lot of variation between different systems and illustrate how some methodologies reach higher precision or recall, how different systems extract different types of terms, how some are exceptionally good at finding rare terms, or are less impacted by term length. The current contribution offers an overview of the shared task with a comparative evaluation, which complements the individual papers by all participants

Een nieuwe rol voor ruimtelijke beleidsevaluatie? Focus op evaluatie in planprocessen van strategische projecten in Vlaanderen

In de afgelopen jaren is het ruimtelijk beleid op Vlaams niveau veelal ad hoc en informeel geëvalueerd. Een globaal en kwalitatief evaluatieprogramma ontbreekt tot op heden. Toch bestaat de overtuiging dat er een meer essentiële rol weggelegd is voor evaluatie in de ruimtelijke beleidscyclus dan momenteel het geval is. Hiertoe is een nieuwe (adaptieve) benadering van het beleid evenwel noodzakelijk. In deze paper worden de mogelijkheden van deze alternatieve benadering in strategische projecten getoetst. De evaluatie (al dan niet onder deze naam) in de planprocessen van deze projecten wordt geanalyseerd en in de beleidscyclus gesitueerd