Changes between Version 11 and Version 12 of WAC-XI


Ignore:
Timestamp:
Feb 13, 2017, 3:36:06 PM (5 years ago)
Author:
Roland Schäfer
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • WAC-XI

    v11 v12  
    1515* [http://rolandschaefer.net Roland Schäfer (Freie Universität Berlin)]
    1616
    17 == Main workshop ==
     17== Workshop description ==
    1818
    19 tba
     19For almost a decade, the ACL SIGWAC, and  most notably the Web as Corpus (WAC) workshops, have served as a platform for researchers interested in the com­pilation, processing and use of web-derived corpora as well as computer-mediated communication. Past workshops were co-located with major conferences on corpus linguistics and/or computational linguis­tics (such as ACL, EACL, Corpus Linguistics, LREC, NAACL, WWW). The eleventh Web as Corpus workshop (WAC-XI) emphasises the linguistic aspects of web corpus research more than the technological aspects while keeping in mind that the two are inseparable.
    2020
    21 == Panel discussion: the !CleanerEval shared task == #cleanereval
     21The World Wide Web has become increasingly popular as a source of linguistic evidence, not only within the computational linguistics community, but also with theoretical linguists facing problems such as data sparseness or the lack of variation in traditional corpora of written language. Accordingly, web corpora continue to gain relevance, given their size and diversity in terms of genres and text types. In lexicography, web data have become a major and well-established resource with dedicated research data and an environment such as the !SketchEngine. In other areas of linguistics, the adoption rate of web corpora has been slower but steady. Furthermore, some areas of research dealing exclusively with web (or similar) data have emerged, such as the con­struction and exploitation of corpora based on short messages. Another example is the (manual or auto­matic) classification of web texts by genre, register, or – more generally speaking – text type, as well as topic area. Similarly, the areas of corpus evaluation and corpus comparison have been advanced greatly through the rise of web cor­pora, mostly because web cor­pora (especially larger ones in the region of several billions of tokens) are often created by download­ing texts from the web unselectively with respect to their text type or content. While the composition (or strati­fication) of such corpora cannot be determined before their construction, it is desirable to evaluate it afterwards, at least. Also, comparing web corpora to corpora that have been compiled in a traditional way is key in determining the quality of web corpora with respect to a given research question.
    2222
    23 As part of the workshop, we plan to organize a panel  discussion as the first meeting of the !CleanerEval shared task on combined paragraph and document quality detection for (web) documents. The !CleanerEval shared task follows the successful !CleanEval shared task organized by SIGWAC in 2006. While !CleanEval focussed specifically on so-called boilerplate removal, !CleanerEval goes beyond this and asks for systems that determine the linguistic quality of paragraphs and whole documents in an automatic fashion, such that corpus designers can decide whether to include them in their corpus or not. In the !CleanerEval setting, boilerplate paragraphs are paragraphs with low quality, but there might be other, non-boilerplate paragraphs with low quality as well. !CleanerEval was proposed by the organizers of WAC-XI during the final discussion of WAC-X, where the proposal was met with enthusiasm. The WAC-XI panel discussion is intended to serve as a platform for the development of the operationalization of the notions of paragraph and document quality, the annotation guidelines, and the final schedule for the shared task. The final meeting of the shared task is planned for to be part of WAC-XII in 2018.
     23The eleventh Web as Corpus workshop (WAC-XI) takes a (corpus) linguistic look at the state of the art in all these areas. More specifically, in linguistic publications presenting case studies based on web data, some authors explicitly discuss and/or defend the validity of web corpus data for a specific type of research question – while others simply take web corpora as a new or complementary source of data without discussing fundamental questions of data quality and appropriateness of web data for specific research questions. We think it is vital to discuss such fundamental questions, and therefore ask researchers to present and discuss
     24
     25* case studies in corpus or computational linguistics where web data have been used
     26* research specifically related to the validity of web data in corpus, computational, and theoretical linguistics,
     27* research on the technical aspects web corpus construction which have a strong influence on theo­retical aspects of corpus design
     28
     29For example, presentations could address questions (either as part of a case study or in the form of primary research):
     30
     31* Are there substantial differences in theoretical inferences when web data are used instead of data from traditionally compiled corpora? If so: Why? Are they expected?
     32* Do findings from traditionally compiled corpora and web corpora converge when compared with evidence from other sources (such as psycholinguistic experiments)? If not: Which type of data matches the external findings better?
     33* Is it possible to analyse lectal variation with web corpora, given the frequent lack of relevant meta data?
     34* How good is the quality of the (automatic) linguistic annotation of web data compared to tradi­tionally compiled corpora? How does this affect empirical linguistic research with web corpora? What could corpus designers do to improve it?
     35* Are there differences with regard to the dispersion of linguistic entities in web corpora com­pared to traditionally compiled corpora? If so: Why? Does it matter? How can we deal with it or even profit from it?
     36* How do very large web corpora compare to smaller, more intentionally stratified web corpora created for a specific task? How can it be decided which type of corpus is better for a given research question?
     37
     38
     39== !CleanerEval first panel discussion ==
     40
     41As part of the workshop and consistent with its general theme, we plan to organise a panel discussion as the first meeting of the !CleanerEval shared task on combined paragraph and document quality detec­tion for (web) documents. The "CleanerEval shared task follows the successful CleanEval shared task organised by SIGWAC in 2006. While !CleanEval focused specifically on boilerplate re­moval (the removal of automatically inserted and frequently repeated non-corpus material from web pages), "CleanerEval goes beyond this basic task. Participating systems should be able to determine the linguistic quality of para­graphs and whole documents in an automatic fashion, such that corpus designers and/or users can decide whether to include them in their corpus or not. In the "CleanerEval setting, boilerplate paragraphs are paragraphs with low quality, but there might be other, non-boilerplate paragraphs with low quality as well. "CleanerEval was proposed by the organisers of WAC-XI during the final discussion of WAC-X, where the proposal was met with great interest. The WAC-XI panel discussion is intended to serve as a platform for the development of the operationalisation of the notions of paragraph and document quality, the an­notation guidelines, and the final schedule for the shared task. There can be no doubt that corpus lin­guists should define what counts as good corpus material and what does not. It would be misguided to threat this ques­tion as a purely technical one. The final meeting of the shared task is planned for to be part of WAC-XII in 2018.
     42
    2443
    2544== Program committee ==
     
    5372=== Important dates ===#dates
    5473
    55 Workshop day: between 24 and 27 July 2017
     74* 13 February 2017: First Call for Workshop Papers
     75* 13 March 2017: Second Call for Workshop Papers
     76* 16 April 2017: Workshop Paper Due Date
     77* 5 June 2017: Notification of Acceptance
     78* 24 July 2017: Workshop Day
    5679
    5780=== Call for papers === #cfp
     
    6588=== Submission format ===
    6689
    67 tba
     90We call for extended abstracts of 1,000 – 1,500 words length (excluding references, tables, and figures).
     91Submissions must be in PDF format. Authors of accepted papers will receive minimal formatting instructions for the publication of the abstracts on the WAC-XI website in due time.
     92There will be no proceedings volume, but a successful workshop might lead to a special issue/edited volume on web (and similar) data in linguistics, for which a separate call for (full) papers would be published after the workshop.