[JAPANESE] [NTCIR Home] [NTCIR DATA Home]

NTCIR-4 PATENT (IR Test Collection)

The collection consists of Document data (Japanese patent applications 1993-1997 and Patent Abstracts of Japan 1993-1997), 101 Japanese search topics (34 topics were translated into English, Simplified and Traditional Chinese, and Korean, respectively), and Relevance judgments for each search topic. Japanese patent applications published in 1993-1997 are used for the Retrieval task. For the Patent Abstracts(paj), "NTCIR-4/5 PATENT Supplement:Patent Abstract Japan," a DVD containing abstracts published in 1993-2002 will be provided. Each search topic is a claim extracted from Japanese patent applications. Relevant documents for a search topic are the patents that can invalidate the demand in the topic claim. The entire collection is provided by NII for research purposes.

＊The entire collection is provided by NII.

Japanese patent applications　1993-1997

The document set consists of Unexamined Japanese patent applications published in 1993-2002, which is the same data set provided by the Japanese Patent Office, but does not include diagrams.

Patent Abstracts of Japan 1993-1997

The Patent Abstracts of Japan are translations of the JAPIO Patent Abstracts, which are edited manually on the basis of summaries in source applications.

Search Topics

Each search topic is a claim in a Japanese patent application. The total number of search topics is 101. Of the 101 topics, 34 main topics were translated into English, Simplified and Traditional Chinese, and Korean, respectively.

Relevance judgement

For all search topics, relevant patents for a topic must be published on a day before the topic patent was filed. For the 34 main topics, the citations provided by examiners of the Japanese Patent Office and the patents identified by professional searchers are used as relevant documents. Relevance judgment was performed based on the following four grades: (A) patent that can invalidate a topic claim, (B) patent that can invalidate a topic claim when used with other patents, (C) irrelevant patent that can be judged by reading the full text, (D) irrelevant patent that can be judged by looking at the title. For the citations, professional searchers judged A or B. For the remaining 67 search topics, only the citations, for which the professional searchers judged A or B, are used as relevant documents.

The followings are the procedures to obtain the test collection. The test collection and data available from NII are free of charge.

• The application form of the test collection must be filled out and sent by E-mail to ntc-secretariat.
• The user agreement (memorandumon Permission to Use Test Collection) is required.
  

  The user agreement form must be filled out and sent by postal mail or courier to the address below.

  Please download and make two copies of the form in double-sided print.

  Signatures are needed on both agreement forms.

  After counter-signed by NII side, one copy of the form will be sent to you and one copy will be kept by the NII.

Documents to submit

• Application Form [txt]
• The User Agreement (sent by email)

Address

NTCIR Project (Rm.1309)
National Institute of Informatics
2-1-2 Hitotsubashi Chiyoda-ku, Tokyo
102-8430, JAPAN

PHONE: +81-3-4212-2750
FAX: +81-3-4212-2751
Email: ntc-secretariat

Mailing List

The release of the new test collections and correction information shall be announced through the ntcir Mailing list

Notice

The test collection has been constructed and used for the NTCIR. They are usable only for the research purpose use.
The documents collection included in the test collection were provided to NII for used in NTCIR free of charge or for a fee. The providers of the document data kindly understand the importance of the test collection in the research on information access technologies and then granted the use of the data for research purpose. Please remember that the document data in the NTCIR test collection is copyrighted and has commercial value as data. It is important for our continued reliable and good relationship with the data producers/providers that we researchers must behave as a reliable partners and use the data only for research purpose under the user agreement and use them carefully not to violate any rights for them .

• ---

  [JAPANESE] [NTCIR Home] [Top of this page] [NTCIR DATA Home]
  Updated on : 2007-07-09
  

  ntc-admin