UPDATE: European Union –Tracing Working Documents

By Patrick Overy

Patrick Overy wasSubject Librarian for Law and Business at the University of Exeter and managed the European Documentation Centre at Exeter from 1991 until he retired in 2016. He was involved in European information networks at national and international levels, especially through the now defunct European Information Association, which published European Information: A Guide to Official Sources in 2005. The 4th edition was published online at the end of 2010 and is available to download from ORE (Open Research Exeter).

Published January/February 2021

(Previously updated in May 2010, May 2013, and in July/August 2016)

See the Archive Version!

1. Introduction

In legal research, particularly in international and comparative law, it is often necessary to trace working documents, or travaux préparatoires, in order to get a clear view of how negotiations have affected the original draft of a document. The status of these documents varies greatly between different countries and organisations: while governments in some countries have long had a culture of openness, others have always preferred secrecy. Reports or articles may often refer to documents to which the author has had privileged access; often the sources are not indicated, and this can be very frustrating for researchers.

Some academics have published collections of such documents independently, while many international organisations, like the Council of Europe, have recognised their importance for research and made selected documents publicly available (for example the Travaux préparatoires for the European Convention of Human Rights).

The situation in the European Union is further complicated because some of the working documents involved originate in the European institutions, while others come from individuals or governments in the member states. In the formative years of the European Communities, which later evolved into the European Union, documents had a relatively informal status. Although many documents relating to the early treaties have been deposited in the official archives, they are not generally available in any other form. Because the proceedings of the institutions and of legislative or treaty negotiations have always been multi-lingual, many documents will only be available in French or German, although official documents were often translated into English even before the United Kingdom joined the European Economic Community in 1973.

Success in tracing working papers depends to a great extent on how complete a reference has been given and whether a document has ever had an official status. Many papers presented at conferences or meetings will have been circulated previously, but the discussions are generally only summarised at a later date and are unlikely to be publicly available. As working papers generally relate either to the legislative process or to policy development, they are frequently allocated multiple references, depending on the context, and this can cause confusion.

The EU has pioneered the use of electronic media in providing information and many official documents are now available online through the EU web server, Europa, and its legal service Eur-Lex, both of which provide information in all official EU languages. However, administrative processes and translation can often cause considerable delays in access, and some documents are never made public.

This article aims to clarify some of the distinctions between different categories of working documents and provides details of some of the databases and collections that are essential for research into the workings of the European Union.

2. Inter-Governmental Conferences (IGCs)

The European Union is a unique creation, as it is not an international organisation but rather a partnership between separate member states. The three Communities, which were the forerunner of the European Union, were created by treaties, which form the basis of all European Union law and policy. The text of all treaties is available in the original published form on the Eur-Lex website under the heading EU law. The negotiation of each treaty has been preceded by an inter-governmental conference (IGC) involving parliamentary representatives, civil servants and heads of government from each country involved. Contributions to these conferences fall into several categories: official statements from the governments of the member states, opinions from individual negotiators, and final statements accompanying the final report.

The first IGC, the 1950-1951 Intergovernmental Conference, was held under the chairmanship of Jean Monnet and involved six countries: Belgium, France, Germany, Italy, Luxembourg and the Netherlands. Negotiations were based on Robert Schuman’s plan to organise Franco-German coal and steel production and led to the establishment of the European Coal and Steel Community in 1951.

The next conference took place at Messina in Sicily in 1955 between the foreign ministers of the six countries under the chairmanship of Paul-Henri Spaak, although observers from other countries, including the United Kingdom, were also present. The Spaak report (Rapport des chefs de délégation aux Ministres des Affaires étrangères: Comité intergouvernemental créé par la Conférence de Messine. Brussels: The Secretariat, 1956) recommended both the creation of a common market for goods and services and a union in the field of nuclear energy. This resulted in the Euratom Treaty and Treaty of Rome in 1957, which created the European Atomic Energy Community and the European Economic Community, respectively.

Although some public statements from these conferences are available, no comprehensive collection of documents exists except for the originals deposited in the official archives.

The next major change to the treaty, the Single European Act of 1987, did not involve an inter-governmental conference but was the subject of wide debate throughout Europe. A 4-volume compilation of all official documents produced within the member states was published in 1993 by the Library of the Court of Justice to help researchers study the historical background of this process: Ratification of the Single European Act: preparatory studies. Luxembourg: OOPEC, 1993. ISBN 9282902285 (set).

The Treaty on European Union (Maastricht Treaty 1992 or TEU) aroused even more debate at the time. A 15-volume compilation collecting official responses from all member states in the original languages was published in 1996: Ratification of the Treaty on European Union: preparatory studies. Luxembourg: OOPEC, 1996. ISBN 9282902994 (set).

The European Commission launched its Europa web server in 1995. The next IGC, in 1996, which culminated in the Treaty of Amsterdam, was the first to make use of online services. A retrospective database of all-important contributions to the debate was available online, but this has now been taken down. The draft treaty presented by the Irish Presidency, “The European Union today and tomorrow," is no longer available online, although a summary from the House of Commons Research Library (IGC issues: progress and the Dublin draft) can still be found asresearch briefing RP96-114. A meeting of the European Council held in Cologne in June 1999 called for an IGC to suggest changes necessary to prepare to welcome countries from the former Communist bloc, as well as Cyprus and Malta, into the European Union. The Treaty of Nice, which resulted from the 2000 IGC, made only limited progress towards this goal.

At the same time, a “Convention,” composed of representatives of the governments and parliaments of the member states, as well as representatives of the European institutions and invited experts, was set up to establish a Charter of Fundamental Rights that was intended to become part of the Treaty. Its aim was to restate the rights implicit in decisions of the Court of Justice, European legislation and other statements.

The European Parliament’s commentary on the Charter cross-refers to relevant national and international law, particularly the European Convention on Human Rights. This site has now been updated and some of the previous content archived.

It was soon realized that the Nice Treaty had not resulted in the desired reforms to the Community institutions. Instead of an IGC, a second convention met between February 2002 and July 2003, chaired by former French President Valéry Giscard d'Estaing. It finally submitted its recommendations, controversially, as a draft constitutional treaty. Some of the contributions to the debate, including the draft text, are available in English, French and German on the website of the CVCE (Le Centre Virtuel de la Connaissance sur l'Europe), a research centre for the study of European integration based in Luxembourg

Public referenda were held on the constitutional treaty in all member states; a majority of citizens in France and the Netherlands rejected it, so a new text was prepared and signed in Lisbon in 2007. Although rejected in a referendum held in Ireland in 2008, the Lisbon Treaty was finally ratified by all member states and came ​into force on January 1st, 2010. While often referred to as the Lisbon or Reform Treaty, it is now officially the Treaty on the Functioning of the European Union (TFEU). An online archive of key documents was available on the Europa website but has since been removed. An online archive on the Council’s Consilium website includes documents from the IGCs of 2004 and 2007.

Although the Secretariat General has maintained an archive of documents from the IGCs for decades, access has always been limited to internal users. In 2008, a new venture was announced to digitise the contents of this archive. This is now available as a public database called DORIE, an acronym for Documentation et Recherche sur les questions Institutionnelles Européennes (Documentation and Research on European Institutional Issues).

3. The European Institutions

The European Union is administered by three main institutions: the European Commission, the European Parliament and the Council of the European Union. In addition, two consultative bodies – the European Economic and Social Committee and the Committee of the Regions – are involved in the legislative process. The Court of Justice of the European Union ensures that the Treaties are correctly interpreted and applied in all member states and settles legal disputes between the states and EU institutions. Working documents are produced by all these institutions and are widely available. It is important to know how these institutions interact to identify where the documents may have originated and how they fit into the legal or administrative system. Two useful guides, “The European Union – what it is and what it does” and “Europe in 12 lessons,” can be downloaded from Europa.eu.

4. Working Documents of the Commission

The Commission of the European Communities, now usually called the European Commission, is the civil service of the European Union. It is the only institution that can propose legislation in European Community law, and as such, a large proportion of its documents relate to the legislative process. Proposals in European Union law (relating to foreign and security policy or to judicial and police cooperation) normally originate either in the member states or in the Council of the European Union. The Commission also administers the Community programmes and budget.

The documents which are most straightforward to identify, if not to trace, are those that appear in numbered series. The Commission issues large numbers of working documents every year with the reference COM (year) in numerical sequence. Some documents may have a reference C or SEC (Secretariat-General). These are internal documents of the Commission, many of which are not publicly available, although some may be found on the websites of individual Directorates-General.

In 2012 a new category, JOIN documents, was introduced and SEC documents were re-labelled SWD. See Preparatory documents on Europa’s Eur-Lex.

4.1. Commission Working Documents (COM Docs)

Draft Legislation: Proposals for legislation (Decisions, Directives or Regulations) are equivalent to bills in the UK. References are normally given as: COM (year) [number] final; only the finalised version of each draft is released publicly, after a period of consultation.

Policy Documents: In 1983, the Commission decided to adopt the terms Green and White papers from UK parliamentary practice, where they refer to the colour of paper used for these publications. In other language versions, these are translated as green and white books, although the term is unfamiliar in other countries.

Green and White Papers: Green Papers concern specific policy areas and are generally used to launch a consultation process with interested individuals and organisations. White Papers are documents containing proposals for Community action and are generally used for consultation before specific proposals for legislation are made. This format has become increasingly popular in the EU as a way of increasing public involvement in the creation of legislation. A full set of Green and White papers from 1983 to 2000 with associated documents is available online in the Archive of European integration.

Communications and Reports: Communications are statements of EU policy on given subjects. Any research or action programmes financed from the EU budget are legally required to present an official report to the institutions after the end of the financial term of the programme; progress and mid-term reports are also becoming more common.

Since 2001, COM documents have only been published online in the “Preparatory documents” section of the Eur-Lex site. Because the European institutions have now moved increasingly to electronic publishing, the production of many official documents has been rationalised. Many reports were also issued as separate documents by the Office for Official Publications (EUR-OP), such as annual reports on employment policy. These annual reports now generally appear as straightforward serial publications, with ISSN (International Standard Serial Number) identification as well as individual catalogue numbers.

Although COM documents are essential research material, no comprehensive official listing is available for the early years. An annual catalogue of COM documents published in English was issued from 1983-84 by EUR-OP with parallel versions for the other official languages. In 1987, a more comprehensive catalogue with the title Documents was inaugurated [ISSN 0256-0976]. Published as a monthly series cumulated in annual volumes, this indexed the COM series, the reports of the European Parliament (EP A2-), the Opinions and Reports of the Economic & Social Committee (CES) and later of the Committee of the Regions (CdR) in a classified sequence with an alphabetical index. This catalogue ceased publication in 2000.

4.2. Joint Communications (JOIN Docs)

As a result of changes introduced by the Lisbon Treaty, documents, which were formerly part of the so-called second pillar of the European Union (Common Foreign and Security Policy or CFSP), were fully integrated into the EU’s legal system. Documents are now jointly issued by the European Commission and the High Representative of the Union for Foreign Affairs and Security Policy and listed as JOIN documents.

4.3. Staff Working Documents (SEC or SWD Docs)

SEC documents (Secretariat-General) are internal documents of the Commission, which are not always publicly available. The allocation of documents to the SEC rather than the COM series appears to the outsider to be largely random: some series of annual reports have appeared as COM documents in some years and as SEC documents in others.

In 2001, the European Council decided that assessments should be made of the economic, social and environmental effects of all new legislation proposed by the Commission. As these assessments are normally published in the SEC series they were often hard to track down, a contradiction of the EU’s public commitment to openness and transparency. In an attempt to remedy this situation, the Secretariat General of the Commission launched a comprehensive website containing all the background documents since 2003 and listing each proposal alongside its assessment. This has also led to a standardisation of practice in the production of impact assessments. Where reports are extremely long it is now normal practice to issue them only in English with a separate executive summary in English, French and German.

New guidelines issued in 2004 aimed to reduce the length of COM documents, both to improve readability and to minimise translating costs (see press release IP/04/679 , available on Press corner, previously known as the RAPID database). As a result, much of the statistical and other background information is now published separately as Commission staff working documents, or SEC documents, which are normally only available in English, French and German.

From 2012, these documents have been re-labelled as SWD (Staff working documents).

4.4. Other Documents of the Commission

C documents are often preliminary versions of COM documents, which have not been subsequently issued in final versions; this category also includes other non-standard documents, such as guidelines to legislation.

Each Directorate-General also issues documents, which vary from short pamphlets and periodicals to detailed research reports. Many are only circulated internally or on request and are generally identified by the acronym for the DG (e.g. ECFIN) or, for documents issued before the reorganisation of the Commission in 1999, by DG number I-XXIII.

5. Documents of the European Parliament

As the only directly elected body in the European Union, the European Parliament (EP) has a crucial role in providing a democratic balance to the legislative and policy-making processes. Most documents from the EP relate to the legislative process, either as reports and studies or as debates. All draft legislation is first presented to the EP, where it is scrutinised by the appropriate Committee. At this point, a Member of the European Parliament (MEP) from that Committee is appointed as "rapporteur," or spokesman. These reports are now only published online.

The Parliament is elected for a five-year term and is now in its ninth term, following the European election of May 2019. References to documents produced within Parliament normally include a reference to the parliamentary term, followed by a running number, e.g. A5-0273/2001. All European Parliament documents are also given an identifying number starting PE.

All documents from 1979 to 1989 were published in print; from 1989-1999 they were published on microfiche. The EP recognised early on the importance of the internet as a means of direct communication with its electorate and launched its own server, Europarl, shortly after Europa. Since 1999, these documents have only been available online via Europarl.

6. Documents of the European Council and Council of the European Union

The Council of the European Union is the EU’s principal decision-making body. It is generally referred to as the Council of Ministers and should not be confused with the Council of Europe, which is not an institution of the European Union. Relatively few public documents are issued by the Council, except for statements regarding foreign policy. Although the Council holds a crucial role in the creation of legislation, virtually no documents are released except for summaries of the discussions.

Where lengthy negotiations are required before a final text is prepared, a “Common position” is published which sets out what the legislation will include. This is sometimes accompanied by a statement of the Council’s position where it disagrees with amendments proposed by the European Parliament. Common positions are normally published in the Official Journal C series.

Proposals for action or legislation under Titles IV and V of the EU Treaty, often referred to as the “second and third pillars,” or Common Foreign and Security Policy (CFSP) and Justice and Home Affairs (JHA), originate with the Council. Both areas were, until the implementation of the Lisbon Treaty, the prerogative of the member states and proposals were not published as Commission documents. They are now available as JOIN documents (see above).

The European Council or Council of the European Union is the quarterly summit of the heads of government of the member states, which draws up general political guidelines for the Union under each six-month Presidency. Although it has met since 1975, the European Council only became an institution in January 2010 following the implementation of the Lisbon Treaty. The Council has its own President (currently Charles Michel) and works with the President of the Commission, heads of government of the member states and the High Representative of the Union for Foreign Affairs and Security Policy. It is distinct from the Council of Ministers, which exists in a number of configurations depending on the topic under discussion.

The conclusions of each Presidency were published in the June and December issues of the Bulletin of the European Community/Union until 2009 (see Official publications section). The conclusions are also available online, generally in PDF format: Councils from 1975-1995 on the Archive of European integration site. A useful report on The Conclusions of the European Council and the Council of Ministers (HC 86)was published by the House of Commons European Scrutiny Committee in 2008. It provides a valuable inside view of how the meetings are conducted.

The Official Journal:All official publications of the European institutions and agencies are published by the Publications Office of the European Union (formerly the Office for Official Publications of the European Communities), often abbreviated to EUR-OP. Documents that are part of the legislative or administrative process are normally published in the Official Journal of the European Union (OJ), which appears on weekdays in 23 of the 24 official languages of the EU (as no Gaelic/Irish edition is produced). The OJ is published in two sequences:

The C Series originally had three sections:

Each issue is now divided into five sections and carries information from European Union institutions, bodies, offices and agencies.

Full details of the Structure of the Official Journal are provided by the Publications Office.

OJ C E (Electronic Series): In 1999, the size of the printed version was reduced by transferring the bulk of the documentation in the C series to an electronic version, which is available online via Eur-Lex. Draft legislation moved to the digital versions of the OJ in 1999; in 2003, it was decided that since COM documents were already available electronically there was no need for duplicate publication in this form. From 2002 onwards both the minutes of the sessions of the European Parliament and the written questions and answers have also been transferred to this format, as have the Council’s Common positions on legislation.

Following a comprehensive digitisation programme in 2008 all issues of the Official Journal since 1952 are now available online. This includes the Special Editions which were published in all new official languages at the time of each member state’s accession to the Community or Union. These contain translations of all European legislation then in force.

Other categories of document, including draft texts of treaties, have only appeared in the Official Journal in recent years, although a selection of important documents was published either in the monthly Bulletin of the European Communities or as supplements to it.

7. Official Archives

Any documents published officially, either as separate volumes, in the Official Journal, or as COM documents, were held in the network of European Documentation Centres (EDCS), which was first established by the European Commission in the 1960s. EDCs serve all the member states and are normally based in the libraries of universities with a special interest in European law and policy. In 2003, they officially became part of a new public information network called Europe Direct. Depository libraries, which are generally based in national or state libraries, have more comprehensive collections and make primary research possible outside Europe. Because so much of this documentation is now available online only the largest institutions can maintain the print collections.

Documents from the inter-governmental conferences have not been published in full, but many are stored in the Historical Archives of the European Union administered by the European University Institute in Florence. The core collection consists of papers from the European institutions held under the 30-year deposit rule, but also includes the papers of individuals and societies active in the promotion of European integration. The holdings of the collection are fully searchable through the website.

The Historical Archives of the European Commission in Brussels stores archives of files from the administrative services of the Commission held under the 30-year rule. These are searchable online via Archisplus on the official website. A digitisation programme is currently underway. Inventories of their holdings published so far are:

Online Databases: A large number of official documents are now available online through the European Union’s web server, Europa, which was first launched in 1995. Although it was initially seen as a useful tool for publicising the EU, Europa soon became established as an essential vehicle for communication with the European citizens, as it allowed almost instant access to a wide range of documents. Like most online sources, however, it is not yet reliable as a permanent archive. Europa was originally seen as a server for the European Commission; because of internal rivalry between the institutions, separate servers were quickly set up by the European Parliament (Europarl), the Council (Consilium), and most other institutions. In 2004 it was decided to re-launch Europa as the European Union’s server and to ensure that cross-linking signposted different sources of information. Simultaneously all official websites were brought into line with URLs indicating their connection with Europa and making use of the EU web domain introduced at that time.

As most Commission documents originate in an individual Directorate-General, it is often worth examining the web pages listed under the appropriate heading in the EU by topic menu of Europa. This is also a quick way of accessing the home pages of relevant Committees in the European Parliament and the European Council.

Several databases are essential for tracing documents relating to the legislative process. The most important is the EU’s legal service, Eur-Lex. This database was first launched in 1998 but has now absorbed the content of the original legal service, Celex, much of which dates back to the 1970s. Since 2004, public access has been free and is available in all official languages, although some material is not provided in all languages. Following a major digitisation programme Eur-Lex now has the full text of all language versions of the Official Journal as originally published and includes all COM documents since 2001, together with a selection since 1999. In 2008 SEC (now SWD), documents were added to this collection, although only a small number are available so far, mainly impact assessments. Eur-Lex was re-launched in 2015.

Because of the complexity of the legislative process, the European Parliament set up its own database to monitor the progress of legislation on Europarl. Legislative observatory (formerly called OEIL) gives detailed chronologies of proposals, whether they are completed or still in progress, and includes links to the online versions of any EP or Commission documents involved.

A similar database, Pre-Lex (Monitoring the decision-making process) was set up by the Secretariat General of the European Commission. Although it has less commentary, it gives a far more comprehensive set of references, including details of opinions from the Committee of Regions and the European Economic and Social Committee (EESC). Earlier documents are not available in full text online, but bibliographic references are given to official publications, including the Official Journal, Bulletin of the European Union, and the General report on the activities of the European Union. This service has now been incorporated in the new version of Eur-Lex as Lawmaking procedures.

8. Access to Documents and Institutional Registers

Appended to the Treaty of European Union (Maastricht Treaty, 1997) was a declaration (no.17) on the right of access to information, which stated that "[t]he Conference considers that transparency of the decision-making process strengthens the democratic nature of the institutions and the public's confidence in the administration. The Conference accordingly recommends that the Commission submits to the Council no later than 1993 a report on measures designed to improve public access to the information available to the institutions."

In 1993, the Council published Decision 93/731/EC of 20 December 1993 on public access to Council documents as a first attempt to permit access, but the legislation and code of conduct accompanying it were widely criticised. Several reports and constant pressure from parliaments and campaigners at national and European level led to Regulation 1049/2001 regarding public access to European Parliament, Council and Commission documents. This lays down the rules for access; Article 11 states that: “In principle, all documents of the institutions should be accessible to the public. However, certain public and private interests should be protected by way of exceptions. The institutions should be entitled to protect their internal consultations and deliberations where necessary to safeguard their ability to carry out their tasks.”

The legislation also gave the institutions notice that public registers should be established by 2002. A public consultation on this Regulation was initiated with a Green paper in 2007. All contributions and documents are available on the European Commission’s Transparency pages. Each of the institutions now has a public register, although they vary in usefulness. All are accessible from Europa on its Official documents pages.

The European Parliament Register has the most flexible search facilities and provides links to related documents as well as full text in most cases.

The European Commission Register is probably the most heavily used but is the least user-friendly. While it allows searches using free text and document number, the register only provides direct access to electronic texts in the COM collection, which are better catered for in Eur-Lex.

The Council of the European Union documents register is perhaps the easiest source of C, COM, JOIN or SEC/SWD documents that are in the public domain. The full text of all SEC documents released for public scrutiny is available in PDF format. The register also includes agendas of meetings, draft conclusions of Council meetings and a wide range of other documents, but a large proportion of these are not available in full text because of rules on secrecy. Searching can be problematic as all documents are given a new reference when added to the register.

Citizens can apply for access to documents that are not publicly available, although this can take a long time and still be unsuccessful. Several civil rights organisations, notably Statewatch, have regularly challenged the unnecessary restrictions placed on access to many documents. The Statewatch archive, most of which is freely available, is a valuable source of commentary and documentation in all areas related to civil liberties around the world.

9. Online Collections

Because of the complexity of the Europa databases and the absence of digitised texts pre-dating the internet, many projects have attempted to create electronic archives that are more closely related to research needs. The Publications Office has now completed a major project to digitise official documents retrospectively.

COM documents are available in full text on Eur-Lex, together with the versions published in the C series of the Official Journal. Early texts have been digitised from printed versions and some collections may be incomplete. English texts can be searched back to 1973; collections in other languages cover the period of the relevant country’s membership of the European Community. Bibliographic details are available for all documents published in the Official Journal since 1958, although earlier documents are not available in English. To search, select the heading Preparatory documents in the section EU law. COM and SWD documents normally appear on Eur-Lex within two or three days of their adoption by the Commission.

Pittsburgh University's European Union Center established the Archive of European Integration(AEI) as an online archive for research materials on the topic of European integration. Thanks to the input of the European Commission’s Office in Washington, it has digitised a large number of official European Union documents, primarily historic documents that are not easily accessible or online elsewhere, like the Spaak report.

The European Documentation Centre of Mannheim University in Germany has for many years led the field in providing help with online sources of European information. Its ArchiDok project archives electronic full text documents published by various EU institutions, concentrating on working papers, reports, studies and grey literature.

10. Further Sources of Information

The free website European Sources Online was set up by the enterprising European Documentation Centre at Cardiff University and continues to provide an exhaustive archive of both official documents and curated background material.