Publications on NTCIR

Studies using NTCIR-1 (Test version)

Studies using NTCIR-1 (Preliminary version)

Studies using NTCIR-1 (Research Purposes version)

Studies using NTCIR-1 and NTCIR-2 (Preliminary version)

Studies using NTCIR-1 and NTCIR-2 (Research Purposes version)

Studies using CIRB010 (Chinese IR Benchmark 1)

Studies using NTCIR-2 SUMM (Text Summarization)

Studies using NTCIR-3 SUMM2 (Preliminary version)

Studies using NTCIR-3 QAC (Preliminary version)

Studies using NTCIR-3 PATENT(Preliminary version)

Studies using NTCIR-3 WEB

Studies using NTCIR-3 (Research Purposes version)

Studies using NTCIR-1 , NTCIR-2 and NTCIR-3 (Research Purposes version)

Studies using NTCIR-4 (Preliminary version)

Studies using NTCIR-4 (Research Purposes version)

Studies using NTCIR-3,and NTCIR-4(Research Purposes version)

Publications on NTCIR

Kageura, K., Koyama, T., Yoshioka, M., Takasu, A., Nozue, T., Tsuji, K. NACSIS corpus project for IR and terminological research. In Natural Language Processing Pacific Rim Symposium 1997. Phuket, Thailand, December, 1997, p. 493-496. [PostScript file] [abst]

Kando, N., Koyama, T., Oyama, K., Kageura, K., Yoshioka, M., Nozue, T., Matsumura, A., Kuriyama, K. NTCIR : NACSIS Test Collection Project. In [Poster] the 20th Annual Colloquium of the British Computer Society Information Retrieval Specialist Group. Autrans, France, March, 1998. [PostScript file] [abst]

Koyama, T., Yoshioka, M., Kageura, K. The construction of a lexically motivated corpus : the problem with defining lexical units. In First International Conference on Language Resources and Evaluation. Granada, Spain, May, 1998, p.1015-1019. [abst]

Kageura, K., Yoshioka, M., Koyama, T., Nozue, T., Tsuji, K. Towards a common testbed for corpus-based computational terminology. In COMPUTERM'98. Montreal, Canada, August, 1998, p. 81-85. [abst]

Nozue, T., Kando, N., Kuriyama, K. Reconsideration of the concept of relevance for NACSIS Test Collection. In Proceeding of the 46th Annual Conference of Japan Society of Library and Information Science. November, 1998, p. 67-70.(in Japanese)

Kando, N. On evaluation of information retrieval systems: Aspects of test collections and competitions (invited). In Proceedings of Informatics Symposium'99. January, 1999,p.129-136.(in Japanese)

Kando, N., Kuriyama, K., Nozue, T., Oyama, K. NTCIR-1(NACSIS Test Collection for Information Retrieval system-1): Its policy and practice . In the Special Interest Group Notes of Information Processing Society of Japan. No. 99-FI-53, March, 1999, p.33-40(in Japanese). [abst]

Yoshioka, M., Okada, M., Kageura, K., Koyama, T. Construction of terminologically-motivated corpus. In the Special Interest Group Notes of Information Processing Society of Japan. No. 98-FI-53, March, 1999, p. 41-48.(in Japanese)

Nozue, T., Kando, N. Primary considerations in the concept of relevance: Relevance judgement of NTCIR (in Japanese). In the Special Interest Group Notes of Information Processing Society of Japan. No. 99-FI-53, March, 1999, p. 49-56.

Kando, N. (organized). New perspective of IR: From test collection to search engine. Open Panel at the 58th Annual Meeting of the Information Processing Society of Japan. March, 1999. (in Japanese) [slides(Japanese only)]

Kuriyama, K., Kando, N., Nozue, T., Oyama, K. Pooling for a large scale test collection : Analysis of the search results for the pre-test of the NTCIR-1 Workshop. In the Special Interest Group Notes of Information Processing Society of Japan. 99-FI-54, May, 1999, p.25-32.(in Japanese)

Kuriyama, K., Kando, N. Construction of a large scale test collection : Analysis of the training topics of the NTCIR-1. In the Special Interest Group Notes of Information Processing Society of Japan. 99-FI-55, July, 1999, p.41-48.(in Japanese)

Kando, N. Cross-lingual information retrieval at NTCIR Workshop (invited). Presented at ACM Digital Libraries and ACM-SIGIR Joint Workshop on Multilingual Information Discovery and Access. Berkeley, CA, USA, August, 1999.

Kando, N., Kuriyama, K., Nozue, T. NACSIS Test Collection Workshop (NTCIR-1). In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Berkeley, CA, USA, August, 1999. [PostScript file]

Kando, N., Nozue, T. (ed.) NTCIR Workshop 1: Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999. 487 p. [http: //research.nii.ac.jp/ ntcir/workshop/OnlineProceedings/]

Kando, N., Kuriyama, K., Nozue, T., Eguchi, K., Kato, H., Hidaka, S. Overview of IR tasks at the first NTCIR workshop. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 11-44.

Kando, N. Cross-lingual information access and its evaluation (invited). In Proceedings of the 4th International Symposium of Digital Libraries. Tsukuba, Japan, September, 1999, p.58-65. [PDF file]

Kuriyama, K., Eguchi, K., Nozue, T., Kando, N. On construction of a large-scale test collection (1); Analysis of the pooling and the relevance assessments. In Proceedings of the 59th Annual Meeting of the Information Processing Society of Japan. September, 1999, p. 3-105 - 3-106.(in Japanese)

Kando, N , Kuriyama, K., Eguchi, K., Nozue, T. On construction of a large-scale test collection (2); Analysis of the search topics. In Proceedings of the 59th Annual Meeting of the Information Processing Society of Japan. September, 1999, p. 3-107 - 3-108. (in Japanese)

Kando, N., Kuriyama, K., Nozue, T., Eguchi, K., Kato, H., Hidaka, S. The NTCIR Workshop : The first evaluation workshop on Japanese text retrieval and cross-lingual information retrieval (invited). In Proceedings of the 4 th International Workshop on Information Retrieval with Asian Languages. Taipei, Taiwan, November, 1999. [PDF file]

Kando, N. NTCIR Workshop: An evaluation of cross-lingual information retrieval (invited). In Proceeding of the 33rd Hawaii International Conference of System Sciences. Maui, HI, USA, January, 2000. [PDF file]

Kando, N. Special feature: New wave of information retrieval. Evaluation of information retrieval systems: Test collections and evaluation workshops. The Journal of Information Science and Technology Association. Vol.50 No.1, January, 2000, p.22-29. (in Japanese)

Kuriyama, K., Kando, N., Nozue, T., Eguchi, K. $B!H(BPooling for a large-scale test collection: Analysis of the search results for the NTCIR-1 Workshop$B!I(B. Research Bulletin of the National Center for Science Information Systems. Vol.12, March, 2000, p.17-30. (in Japanese)

Oyama, K., Kando, N., Satoh, S., Kato, H., Hidaka, S. $B!H(BDevelopment of an online journal editing and publishing system$B!I(B. Research Bulletin of the National Center for Science Information Systems. Vol.12, Mar. 2000, p.111-120. (in Japanese)

Kando, N. The first NTCIR Workshop: An evaluation forum on information retrieval and automatic term recognition. NACSIS News. No.50, March, 2000, p.11-13. (in Japanese) [html]

Kando, N. The NTCIR Workshop: The first evaluation workshop of Japanese text retrival and automatic term recognition. NACSIS Newsletter. No.20, March, 2000, p.10-12.

Kageura, K., Fukushima, T., Kando, N., Okumura, M., Sekine, S., Kuriyama, K., Takeuchi, K., Yoshioka, M., Koyama, T. and Isahara, H. IR/IE/Summarisation Evaluation Projects in Japan. In Proceedings of LREC 2000 Workshop on Using Evaluation within HLT Programs, Athens, Greece. May 31, 2000, p. 19-22.

Kando, N. The NTCIR Workshop: An evaluation of Asian language information retrieval. RIAO'2000, Panel on IR Evaluation World Wide. Paris, France, April 12-14, 2000.

Kando, N. Evaluation of Japanese Text Retrieval Systems : NTCIR Workshop and Test Collections. In Proceedings of the 14th Meeting of the SIGMOD Japan. Tokyo, April, 2000. (invited)

Kando, N. Information retrieval systems evaluation project: NTCIR Workshop. IPSJ Magazine. Vol.41 No.6, June, 2000, p.689-697.(in Japanese)

Eguchi, K., Kuriyama, K., Kando, N. Analysis of the Topic Difficulty for NTCIR-1: NACSIS Test Collection for Information Retrieval System-1 (in Japanese). In the Special Interest Group Notes of Information Processing Society of Japan, No. 2000-FI-59, Jul. 2000, pp.25-32.

Kuriyama, K., Kando, N. Test Collections for Information Retrieval Systems. Humanities and Information Processing. No. 28, July, 2000.

Kando, N. What shall we evaluate? Preliminary discussion for the NTCIR Patent IR Challenge based on the brainstorming with the specialized intermediaries in patent searching and paten attorneys. ACM-SIGIR Workshop on Patent Retrieval, Athens, Greece, July 28, 2000, p.37-42.

Kando, N (editor). Special Features: Let's See What Your Systems Can Do, Evaluating Information Retrieval Systems using Test Collections. IPSJ Magazine. Vol. 41, no. 8, series no. 426. August, 2000, p.897-924.

Kishida, K. Information Retrieval Techniques and Test Collection. IPSJ Magazine. Vol. 41, no. 8, series no. 426. August, 2000, p.898-901.

Sekine, S., Isahara, H., Kuriyama, K. Activities of IR Test Collection and Evaluation in Japan. IPSJ Magazine. Vol. 41, no. 8, series no. 426. August, 2000, p.902-905.

Yamamoto, M., Umemura, K. IR Test Collections and Competition Style Workshops from the Viewpoints of Academic Research. IPSJ Magazine. Vol. 41, no. 8, series no. 426. August, 2000, p.906-907.

Fujita, S. IR Test Collections and Competition Style Workshops from the Viewpoints of Industrial Research. IPSJ Magazine. Vol. 41, no. 8, series no. 426. August, 2000, p.908-910.

Gey, F. C., Chen, A., Jiang, H. Lessons Learned from the University of California Participation in the First NTCIR Workshop. IPSJ Magazine. Vol. 41, no. 8, series no. 426. August, 2000. p.910-912.

Fukushima, T. WWW Information Retrieval Technologies and Evaluation Problems. IPSJ Magazine. Vol. 41, no. 8, series no. 426. August, 2000, p.913-916.

Okumura, M., Fukushima, T. A New Sub-Task in the NTCIR Workshop 2- Automatic Text Summarization. IPSJ Magazine. Vol. 41, no. 8, series no. 426. August, 2000, p.917-920.

Kando, N. Way Ahead of Information Retrieval Evaluation. IPSJ Magazine. Vol. 41, no. 8, series no. 426. August, 2000, p.921-923.

Kando, N. NTCIR and its way ahead. The first workshop of the Cross Language Evaluation Forum, the fourth European Conference on Digital Libraries, Panel on CLIR Evaluation in the Future. Lisbon, Portugal, Sept. 21-22, 2000. (invited)

Kando, N. "NTCIR Workshop: Japanese- and Chinese-English Cross-Lingual Information Retrieval and Multi-grade Relevance Judgments. In Proceedings of the first workshop of the Cross Language Evaluation Forum, Lisbon, Sept. 22-23, 2000. (Springer Lecture Notes on Computer Science) (invited, to appear)

Kando, N. NTICR Workshop: Evaluation of Asian Information Retrieval and Text Processing. Presented at Panel on IR Evaluation, the 5th International Workshop on Information Retrieval with Asian Languages, Hong Kong, Sept. 29-Oct.1, 2000. (invited)

Kando, N. English-Japanese Cross-lingual Information Retrieval of Scientific and Technical Information. Presented at the Panel on Conquering the Babel: Cross-language Retrieval on the Web. In Proceedings of the 63rd Annual Meeting of the American Society for Information Science, Chicago, IL, Nov.12-16, 2000, p.2-3. (invited)

Kando, N., Adachi, J. NTCIR Workshops : Data Collection-Based Evaluation of Information Retrieval and its Challenges. In Proceedings of 2000 Kyoto International Conference on Digital Libraries : Research and Practice, Kyoto, Nov. 13-16, 2000, IEEE Computer Society Press. (invited, to appear)

Eguchi, K., Kuriyama, K., Kando, N. Analysis of the Topic Difficulty for NTCIR (NACSIS Test Collection for Information Retrieval Systems). In Proceedings of the 3rd International Conference of Asian Digital Libraries (ICADL 2000). Seoul, Korea, December, 2000, pp.231-238.

Kando, N. Overview of the Second NTCIR Workshop (Draft). Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.4-1-4-8.

Fukushima, T., Okumura, M. Text Summarization Challenge: Text Summarization Evaluation at NTCIR Workshop2. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.4-9-4-13.

Chen, K., Chen, H. The Chinese Text Retrieval Tasks of NTCIR-II Workshop. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.4-15-4-36.

Kando, N. Overview of the Japanese and English IR Tasks at the Second NTCIR Workshop (Draft). Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.4-37-4-59.

Yoshioka, M., Kuriyama, K., Kando, N. Analysis of the Usage of Japanese Segmented Texts in NTCIR Workshop 2. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-184-5-189.

Kuriyama, K., Yoshioka, M., Kando, N. The Effect of Cross-Lingual Pooling on Evaluation. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-190-5-203.

Fukumoto, J., Kato, T. An Overview of Question and Answering Challenge (QAC) of the Next NTCIR Workshop. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.7-1-7-3.

Nanba, H., Okumura, M. Analysis of the Results and Evaluation Methods of Text Summarization Challenge (TSC), A Subtask of NTCIR Workshop 2. IPSJ SIG Notes. Vol. 2001, No. 69, 2001-NL-144. July 16$B!&(B17, 2001. p.143-150.

Kando, N., Okumura, M., Fukushima, T. Evaluation of Information Retrieval and Text Summarization Systems. Overview of the Second NTCIR Workshop. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.1-8.

Kuriyama, K., Yoshioka, M., Kando, N. Construction of a Large Scale Test Collection NTCIR-2. The Effect of Cross-Lingual Pooling on Evaluation. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.9-16.

Eguchi, K., Kuriyama, K., Kando, N. Challenge to Predict Topic Difficulty in Test Collections. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.17-24.

Fukumoto, J., Kato, T. An Overview of Question and Answering Challenge (QAC) of the NTCIR3 Workshop. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.25-31.

Okumura, M., Fukushima, T. The Goal of Text Summarization Challenge 2. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.33-39.

Oyama, K., Kando, N., Eguchi, K., Kuriyama, K. Consideration on Web Information Retrieval Challenge. A New Task of NTCIR Workshop-3. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.41-48.

Iwayama, M., Fujii, A., Takano, A., Kando, N. Patent Retrieval Challenge in NTCIR-3. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.49-56.

Kishida, K. Property of Mean Average Precision as Performance Measure in Retrieval Experiment. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.97-104.

Kando, N., Kuriyama, K., Yoshioka, M. Information Retrieval System Evaluation using Multi-grade Relevance Judgments. Discussion on Averageable Single-numbered Measures. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.105-112.

Kando, N. NTCIR and Its Background -Evaluation Workshop on Information Access Technologies and Test Collections-. JSAI.vol. 17, no. 3, 2002, p. 296-300.

Fukushima, T., Okumura M., Kato, T. Trends in Text Procedding Research -Role of Evaluation Workshop ni Information Extranction, Automatic Text Summarization and Question Anewering-. JSAI. vol. 17, no. 3, 2002, p. 301-305.

Ogawa, Y., Sasaki,Y., Masuyama, S., Murata, M., Yoshioka,M. NTCIR from Participants' Viewpoints. JSAI. vol. 17, no. 3, 2002, p. 306-311.

Kando, N., Adachi, J. Research on Text Processing Technologies through on Evaliation Workshop -The Case of NTCIR Workshop 3-. JSAI. vol. 17, no. 3, 2002, p. 312-319.

Itou, K., Fujii,A. LANGUAGE MODELING FOR MULTI-DOMAIN SPEECH-DRIVEN TEXT RETRIEVAL. IEEE Automatic Speech Recognition and Understanding Workshop, Trento Italy, December 9-13, 2001, CD-ROM (It doesn't have a page number.)

Studies using NTCIR-1 (Test version)

* Note: The Test version of the NTCIR-1 was compiled prior to the Preliminary version. The number of documents in NTCIR-1 (Test version) is almost same that the NTCIR-1 (Preliminary version) has, but the document size and the collecion size are different.

Kuriyama, K. Query expansion using thesauri. In the Special Interest Group Notes of Information Processing Society of Japan. No. 98-FI-52, January, 1998, p. 1-8.(in Japanese)

Kando, N., Kageura, K., Yoshioka, M., Oyama, K. Phrase processing methods for japanese text retrieval. In ACM-SIGIR '98 Workshop on "Information Retrieval : Theory into Practice. Melbourne, Australia, August, 1998, p.13-19. [abst] [PostScript file]

Aizawa, A., Kando, N., Kageura, K. A graph-based method for automatic generation of multilingual keyword clusters and its applications. In International Joint Digital Library Workshop '98. Bangkok, Thailand, September, 1998.

Kando, N., Aizawa, A. Cross-lingual information retrieval using automatically generated multilingual keyword clusters. In the Proceedings of 3rd International Workshop on Information Retireval with Asian Languages. Singapore, Singapore, October, 1998, p. 86-94. [abst] [PostScript file]

Kando, N., Aizawa, A., Tsuji, K., Kageura, K., Kuriyama, K. Cross-language information retrieval and automatic construction of multilingual lexicons. In 1998 Anuual Meeting of the American Society for Information Science. Pittbergh, U.S.A, October, 1998.

Kando, N., Aizawa, A. Cross-lingual information retrieval of scholary information: Using automatical created multilingual keyword clusters. In Proceeding of the 46th Annual Conference of Japan Society of Library and Information Science. November, 1998, p. 63-66.(in Japanese)

Kando, N., Kageura, K., Yoshioka, M., Oyama, K. Phrase processing methods for Japanese text retrieval. SIGIR Forum. Vol.32, No.2, 1998, p. 23-28.

Studies using NTCIR-1 (Preliminary version)

Fujii, A., Ishikawa, T. Cross-language information retrieval for technical documents. In Proceedings of the Joint ACL SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora. College Park, MD, USA, Junuary, 1999, p. 29-37.

Kanazawa, T. An information retrieval method using a relevance-based superimposition model (in Japanese). Master Thesis, University of Tokyo. February. 1999.

Kanazawa, T., Takasu, A., Adachi, J. Document retrieval with relevance-based superimposition model. In the 10th Data Engineering Workshop, the Institute of Electronics, Information and Communication Engineers. No. 5B-5, March, 1999.

Ozawa, T., Yamamoto, M., Yamamoto, E., Umemura, K. Word segmentation of query sentences using similarity measures for IR. Proceedings of the Fifth Annual Meeting of The Association for Natural Language Processing. March, 1999, p.305-308.

Fujii, A., Ishikawa, T. Quest: A cross-language information retrieval system. In Proceedings of the Fifth Annual Meeting of the Association for Natural Language Processing. March, 1999, p. 353-356.(in Japanese)

Tsuji, K., Yoshikane, F., Kageura, K. Acquisition of translational pairs from parallel corpora using dictionary. In Proceedings of the Fifth Annual Meeting of the Association for Natural Language Processing. March, 1999, p. 402-405. (in Japanese)

Kanazawa, T., Takasu, A., Adachi, J. Query expansion with the relevance-based superimposition model (in japanese). In Proceedings of the Database Workshop 1999. No. 5C-3, Okinawa, Japan, July, 1999.

Chen, A., Kishida, K., Jiang, H, Liang, Q., Gey, F. C. Automatic construction of Japanese-English lexicon and its application to cross-language information retrieval. In ACM Digital Libraries and ACM-SIGIR Joint Workshop on Multilingual Information Discovery and Access. Berkeley, CA, USA, August, 1999. [http://www.clis.umd.edu/conferences/midas/papers/Welcome.html]

Kando, N., Kuriyama, K., Nozue, T., Eguchi, K., Kato, H., Hidaka, S. Overview of IR tasks at the first NTCIR Workshop. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 11-44.

Ogawa, Y. NTCIR advisor report. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 45-46. (in japanese) [PDF file(in English)]

Chen, A., Gey, F. C., Kishida, K., Jiang, H., Liang, Q. Comparing multiple methods for Japanese and Japanese-English text retrieval. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 49-58. [PDF file]

Murata, M., Uchimoto, K., Ozaku, H., Isahara, H. Information retrieval based on stochastic models. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 59-70. [PDF file]

Sato, M., Ito, H., Noguchi, N. NTCIR experiments at Matsushita: Ad-hoc and CLIR task. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 71-81. [PDF file]

Kanazawa, T. R2D2 at NTCIR: Using the relevance-based superimposition model. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 83-88. [PDF file]

Ozawa, T., Yamamoto, M., Umemura, K., Church, K. W. Japanese word segmentation using similarity measure for IR. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 89-96. [PDF file]

Vines, P., Wilkinson, R. Experiments with Japanese information retrieval using mg. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 97-100.

Fujita, S. Notes on phrasal indexing: JSCB evaluation experiments at NTCIR AD HOC. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 101-108. [PDF file]

Ohira, S., Shirai, K. Proposal and evaluation of significant words selection method based on AIC. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 109-116. [PDF file]

Matsumura, A., Takasu, A., Adachi, J. Structured index system at NTCIR1: Information retrieval using dependency relationship between words. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 117-122. [PDF file]

Niwa, Y., Iwayama, M., Hisamitsu, T., Nishioka, S., Takano, A., Sakurai, H., Imaichi, O. Interactive document search with DualNAVI. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 123-130. [PDF file]

Sawada, R., Umemura, K. Dynamic programming: A new paradigm for information retrieval. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 131-136. [PDF file]

Sakai, T., Shibazaki, Y., Suzuki, M., Kajiura, M., Manabe, T., Sumita, K. Cross-language information retrieval for NTCIR at Toshiba. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 137-144. [PDF file]

Lin, C., Lin, W., Bian, G., Chen, H. Description of the NTU Japanese-English cross-lingual information retrieval system used for NTCIR workshop. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 145-148. [PDF file]

Nakazawa, S., Ochiai, T., Satoh, K., Okumura, A. Cross language information retrieval based on comparable corpora. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 149-155. [PDF file]

Oard, D. W., Wang, J. NTCIR CLIR experiments at the University of Maryland. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 157-161. [PDF file]

Fujii, A., Ishikawa, T. Cross-language information retrieval at ULIS. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 163-169. [PDF file]

Mizobuchi, S., Lee, S., Kawano, F., Kobayashi, T., Komatsu, T., Aoe, J. Multi-lingual multi-media information retrieval system. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 171-178. [PDF file]

Fukushima, T., Akamine, S. A character-based indexing and word-based ranking method for Japanese text retrieval. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 179-182. [PDF file]

Umemoto, H., Kuramochi, T., Ishitobi, Y., Tateno, M. Development of a related document retrieval system and evaluation of the system using NTCIR-1. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 183-185. [PDF file]

Kato, T., Shimada, S., Kumamoto, M., Matsuzawa, K. Idea-deriving information retrieval system. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 187-193. [PDF file]

Kameda, H., Oomori, N., Kubomura, C., Tanifuji, Y. An advanced system for information retrieval via key concepts. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 195-201. [PDF file]

Kageura, K., Yoshioka, M., Takeuchi, K., Koyama, T., Tsuji, K., Yoshikane, F., Okada, M. Overview of TMREC tasks. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 415-416.

Kageura, K., Yoshioka, M., Tsuji, K., Yoshikane, F., Takeuchi, K., Koyama, T. Evaluation of the term recognition task. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 417-434.

Takeuchi, K., Yoshioka, M., Koyama, T., Kageura, K. Evaluation of the keyword extraction task. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p.435-436.

Koyama, T., Yoshioka, M., Takeuchi, K., Kageura, K. Evaluation of the role analysis task. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 437-439.

Uchimoto, K., Sekine, S., Murata, M., Ozaku, H., Isahara, H. Term recognition by using different field corpora. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 443-450. [PDF file]

Nakagawa, H. Compound noun based system for automatic term recognition task. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 451-458.

Morimoto, T., Maeshiro, T., Fujiwara, Y. Extraction of semantic relationships among terms to construct organized knowledge resources. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 459-465.

Fukushige, Y., Noguchi, N. NTCIR experiments at Matsushita: TMREC task. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 467-474. [PDF file]

Hisamitsu, T., Niwa, Y., Nishioka, S., Sakurai, H., Imaichi, O., Iwayama, M., Takano, A. Term extraction using a new measure of term representativeness. In Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, August, 1999, p. 475-481. [PDF file]

Gey, F., Chen, A., Jiang, H. Applying text categorization to vacabulary enhancement for Japanese-English cross-language retrieval. In the 7 th Machine Translation Summit Workshop Machine Translation for Cross Language Information Retrieval. Singapore, Singapore, September, 1999, p.35-39.

Kanazawa, T., Takasu, A., Adachi, J. Automatic query expansion with relevance-based superimposition model (in Japanese). In Proceedings of the 59th Annual Meeting of the Information Processing Society of Japan. September, 1999, p. 3-21 - 3-22.

Matsumura, A., Takasu, A., Adachi, J. Effect of the Structured Index on Abstract Retrieval. In Proceedings of the 59th Annual Meeting of the Information Processing Society of Japan. 2P-6, September, 1999, pp.(3-69)-(3-70).

Rorvig, M., Smith, M. M., Uemura, A. The n-gram hypothesis applied to matched sets of visualized Japanese-English technical documents. In Proceedings of the 62nd Annual Meeting of the Amerian Society for Information Science. Washington DC, USA, November, 1999.

Fujii, A., Ishikawa, T. Japanese/English Cross-Language Information Retrieval. Technical Report RR-00.23, University of Roma. Tor Vergata. January, 2000.

Feng, L., Umemura, K. Using variable length ngrams for retrieving technical abstracts in Japanese. In Proceedings of the 60th Annual Meeting of the Information Processing Society of Japan. March, 2000.

Fujii, A., Ishikawa, T. Translating compound words in the cross-language information retrieval of technical documents. Transactions of Information Processing Society of Japan. Vol.41 No.4, April, 2000, p.1038-1045.

Matsumura, A., Takasu, A., Adachi, J. Evaluation of Information Retrieval Method Using Dependency Relationships Between Words. IPSJ Transactions on Database, Vol.41 no.SIG1(TOD5), 2000, pp.22-30.

Matsumura, A., Takasu, A., Adachi, J. The Effect of Information Retrieval Method Using Dependency Relationship Between Words. In the Proceedings of the RIAO'2000 Conferenece, April 12-14, 2000, pp.1043-1058.

Matsumura, A., Takasu, A., Adachi, J. Evaluation of Full-Text Search Using Structured Index. Technical report of IEICE, DE2000-68, 2000, pp.209-126. IPSJ SIG Notes, Vol. 2000, no.69, 2000, pp.353-360.

Matsumura, A., Takasu, A., Adachi, J. Effect of Dependency Relationship and Ordered Co-occurrence of Words on Japanese Information Retrieval. Proceedings of the 5th International Workshop on Information Retrieval with Asian Languages(IRAL2000), September 30-October 1, 2000, pp.199-200.

Matsumura, A., Takasu, A., Adachi, J. Abstract Retrieval Using Ordered Co-occurrence of Words and their Dependency Relationships. The 61st Annual Convention IPSJ, 3U-7, 2000, pp.(3-165)-(3-166).

Studies using NTCIR-1 (Research Purposes Version)

Yamamoto, E., Yamamoto, M., Umemura, K., Kenneth W. Church. Dynamic programming: A method for taking advantage of technical terminology in Japanese documents. IPSJ Programming Symposium Vol.41, January, 2000, pp.131-141.

Fujii, A., Ishikawa, T. Utilizing the World Wide Web as an encyclopedia. In Proceedings of The 6th Annual Meeting of The Association for Natural Language Processing. March, 2000, p.296-299.

Fujii, A., Ishikawa, T. Using machine translation for cross-language information retrieval. In Proceedings of The 6th Annual Meeting of The Association for Natural Language Processing. March, 2000, p.455-458.

Fujii, A., Ishikawa, T. Collecting Encyclopedic Knowledge Using the World Wide Web. Japanese Society for Artificial Intelligence, SIG-KBS-A001. June, 2000, pp.31-36.

Yamamoto, E., Umemura, K., Yamamoto, M., Kenneth W. Church. A retrieval method based on dynamic programming. Technical report of the Institute of Electronics, Information and Communication Engineers. Vol.100 No.201, NLC2000-17$B!A(B21, July, 2000, p.9-15.

Yamamoto, E., Takeda, Y., Umemura, K., Yamamoto, M. A similarity measure suitable for information retrieval and tolerant for morphological variation. In the Special Interest Group Notes of Information Processing Society of Japan. Vol.2000 No.71, 2000-FI-59 2000-DD-24, July, 2000, p.9-15.

Kanazawa, T., Takasu, A., Adachi, J. Retrieval Effectiveness for English Text Using the Relevance-based Superimposition Model. IPSJ SIG Notes (2000-DBS-122), IEICE SIG Notes. July, 2000.

Umemura, K., Kenneth W. Church. Empirical Term Weighting and Expansion Frequency. Proceedings of the WVLC-2000, ACL SIGDAT conference EMNLP. September 2000, pp.117-123. Hong Kong.

Yamamoto, E., Yamamoto, M., Umemura, K., Kenneth W. Church. Dynamic Programming: A Method for Taking Advantage of Technical Terminology in Japanese Documents. Proceedings of the Fifth International Workshop on Information Retrieval with Asian Languages. September 30 to October 2, 2000, pp.125-132. Hong Kong.

Kanazawa, T., Takasu, A., Adachi, J. Effect of the Relevance-based Superimposition Model on Information Retrieval. In the proceedings of the 61st National Convention of IPSJ. October, 2000.

Fujii, A., Ishikawa, T. Applying Machine Translation to Two-Stage Cross-Language Information Retrieval. Proceedings of the 4th Conference of the Association for Machine Translation in the Americas. October 2000, pp.13-24.

Fujii, A., Ishikawa, T. Utilizing the World Wide Web as an Encyclopedia: Extracting Term Description from Semi-Structured Texts. Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics. October 2000, pp.488-495.

Rorving, M., Fitzpatrick, S. Shape Recovery: A Visual Method for Evaluation of Information Retrieval Experiments. Journal of the American Society for Information Science. 51(13), November 2000, pp.1205-1210.

Fujita, S. Evaluation of Japanese Phrasal Indexing with a Large Test Collection, in RIAO2000 Conference proceedings, Paris, 2000, 1089-1098.

Fujita, S. Discriminative Power and Retrieval Effectiveness of Phrasal Indexing Terms, in Proceedings of the ACL-2000 Workshop on Recent Advances in Natural Language Processing and Information Retrieval, Hong Kong, 2000, 47-55.

Fujii, A., Ishikawa, T. Japanese-English Cross-Language Information Retrieval Integrating Query and Document Translation Methods. The Transactions of the Institute of Electronics, Information and Communication Engineers, Vol. J84-D-II, no. 2, February 2001, pp.362-369.

Aizawa, A. An Approach to Text Categorization Problems Using Naive Methods. In Proc. of 2001 Workshop on Information-Based Induction Science (IBIS 2001), pp. 123-128.

Fujii, A., Ishikawa, T. Japanese/English Cross-Language Information Retrieval : Exploration of Query Translation and Transliteration, Computers and the Humanities 35, 2001, Netherlands, p389-420

Xinghui Xu,kyoji Umemura Literal Maching Biased Link Analysis LNCS(lecture Note of Computer Science),Vol.34411,Springer,p.153-164,2005

Studies using NTCIR-1 and NTCIR-2 (Preliminary version)

Sakai, T., Robertson, S., Walker, S. Flexible Pseudo-Relevance Feedback for NTCIR-2. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-59-5-66.

Mori, T., Kokubu, T., Tanaka, T. Cross-Lingual Information Retrieval based on LSI with Multiple Word Spaces. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-67-5-74.

Fujita, S. Notes on the Limits of CLIR Effectiveness: NTCIR-2 Evaluation Experiments at Justsystem. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-75-5-82.

Kishida, K. Regression Model and Query Expansion for NTCIR-2 Ad Hoc Retrieval Task. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-83-5-89.

Iwayama, M., Niwa, Y., Nishioka, S., Takano, A., Hisamitsu, T., Imaichi, O., Sakurai, H., Fujio, M. The Effect of Document Clustering in Interactive Relevance Feedback. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-90-5-97.

Kanazawa, T., Takasu, A., Adachi, J. R2D2 at NTCIR 2 Ad-hoc Task: Relevance-based Superimposition Model for IR. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-98-5-104.

Kluev, V., Bessonov, M., Dobrynin, V. NTCIR Experiments Using the OASIS System. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-105-5-109.

Umemura, K., Takeda, Y., Tanaka, M., Feng, L., Yamamoto E. Empirical Term Weighting. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-110-5-115.

Sakai, H., Ohtake, K., Masuyama, S. On a Retrieval Support System by suggesting terms to a user. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-116-5-120.

Ogawa, Y., Mano, H. RICOH at NTCIR-2. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-121-5-123.

Sato, T., Hata, N., Hiraiwa, K. Kobata, K., Furusho, A., Han, K. NTCIR-2 Experiments Using Long Gram Based Indices. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-124-5-128.

Morimoto, T., Kondo, T., Sugita, K. Ishikawa, D., Ikemura, M., Fujiwara, Y. The Intelligent Method of Information Retrieval Based on Self Organized Knowledge Resources. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-129-5-135.

Tanimura, S., Suzuki, M., Nakagawa, H. Mori, T. Japanese and English Cross-lingual Information Retrieval at DLUT. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-136-5-143.

Fujii, A., Ishikawa, T. Evaluating Multi-lingual Information Retrieval and Clustering at ULIS. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-144-5-148.

Matsumura, A., Takasu, A., Adachi, J. Structured Index System at NTCIR Workshop 2: Information Retrieval Methods Using Ordered Co-occurrence of Words and their Dependency Relationships. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-149-5-156.

McNamee, P. Experiments in the Retrieval of Unsegmented Japanese Text at the NTCIR-2 Workshop. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-157-5-162.

Umemoto, H., Miyauchi, T., Ueda, Y. Document Retrieval in Consideration of the Amount of Term Frequencies. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-163-5-166.

Isogai, S., Ohira, S., Shirai, K. Information Retrieval using Relevance Feedback. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-167-5-172.

Sato, M., Noguchi, N. NTCIR-2 Experiments at Matsushiita: Monolingual and Cross-Lingual IR Tasks. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-173-5-178.

Jiang, F., Littman, M. Approximate Dimension Reduction at NTCIR. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-179-5-183.

Studies using NTCIR-1 and NTCIR-2 (Research Purposes Version)

Uchiyama, M., Isahara, H. Implementation of an IR package. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.57-64.

Fujii, A., Itou, K., Akiba, T., Ishikawa, T. A Speech-Driven Text Retrieval System and its Evaluation Using a Test Collection. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.65-72.

Kanazawa, T., Aizawa, A., Takasu, A., Adachi, J. Cross-Language Information Retrieval Using the Relevance-based Superimposition Model. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.73-80.

Mori, T. Large-scaled Cross-Language Information Retrieval based on Segmented CL-LSI. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.81-88.

Fujita, S. NTCIR-2 as a Rosetta Stone in Laboratory Experiments of IR Systems. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.89-96.

yoshiyuki takeda,kyojiUmemura,Eiko Yamamoto Determining Indexing Strings with Satistical Anakysis IECE TRANS.INF &SYST,Vol.E(86-Dno/9,pp/1781-1797,2003

T.Ogata,K..Terao,K.Umemura Japanese multowprd Extraction using SVM and Adaptaion LREC-2004 Workshop on methodologies anda Evaluation of Multiwaord Units in Real-word Applications.pp/1-4,2004(lisbon,portugal

Xinghui Xu,kyoji Uemura Very Low Dimentional Latent Semantic Indexing for Local Query Regions Sixth International Workshop on Information Retrival with Asian Languages (IRAL-2003),pp.84-91,2003

Eiko Ymamoto,kyouji Umemura Related Word-pairs Extraction without Dictionaries LREC-2004 Workshop on methodologies anda Evaluation of Multiwaord Units in Real-word Applications.pp.1309-1312,2004(lisbon,portugal

Matsumura, A., Takasu, A., Adachi, J. Effect of arelationships between Words on Information Retrieval Interest Group Notes of Information Processing Society of Japan VOL.2001,N0 70,P257-264,20011

Junan Chakma ,Kyouji Uemura Factor Controlled Hierarchical SOM Visualization for Large Set of Data IEICETRANS.INF & SYST.Vol.E86-D No/9,pp.1796-1803,2003

Kenichirou Terao, Kyouji Uemura Obtaining Generalized Document Frequencies for Very Large Corpus Summer Programing Symposium of Information Processing Society of Japan"DATA NO TATUSJIN"p.25-36 2003

Kenta Nakase ,Kyouji Umemura Technical terms extraction using adaptation of bigram the 46th Workshop on Special Interest Group on Digital Documents （IPSJ-DD04046003),Vol.2004,No.97,pp.15-20,2004

Keiichiro Kobayashi ,kyoji Umemura ,Atushi Kanaya Verification of Empirical Term Weighting for Query Expansion In The 67th National Convention of IPSJ Session No.6M-4 ,200

Studies using CIRB010 (Chinese IR Benchmark 1)

Oard, D., Wang, J. NTCIR-2 ECIR Experiments at Maryland: Comparing Structured Queries and Balanced Translation. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-1-5-7.

Bian, G., Lin, C. Description of the Trans-EZ English-Chinese Cross-Lingual Information Retrieval. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-8-5-13.

Kwok, K.L. NTCIR-2 Chinese, Cross Language Retrieval Experiments Using PIRCS. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-14-5-20.

Murata, M., Utiyama, M., Ma, Q., Ozaku, H., Isahara, H. CRL at NTCIR2. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-21-5-31.

Chen, A., Jiang, H., Gey, F. Berkeley at NTCIR-2: Chinese, Japanese, and English IR experiments. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-32-5-40.

Yibo, Z., Le, S., Lin, D., Youbing, J., Yufang, S. ISCAS: Text Retrieval in NTCIR Workshop II. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-41-5-48.

Chang, J., Yu, D., Shen, C., Cheng, A., Shen, Garfield., Shen, Giordano., Wong, D. Nathu IR System at NTCIR-II. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-49-5-52.

Youli, Q., Guowei, X., Jun, W. Rerank Method Based on Individual Thesaurus. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-53-5-58.

Studies using NTCIR-2 SUMM (Text Summarization)

Mori, T., Kikuchi, M., Yoshida, K. Term Weighting Method based on Information Gain Ratio for Summarizing Documents retrieved by IR systems. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-205-5-212.

Nobata, C., Sekine, S., Murata, M., Uchimoto., K., Utiyama, M., Isahara, H. Sentence Extraction System Assembling Multiple Evidence. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-213-5-218.

Ishikawa, K., Ando, S., Okumura, A. Hybrid Text Summarization Method based on the TF Method and the Lead Method. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-219-5-224.

Otake, K., Okamoto, D., Kodama, M., Masuyama, S. Yet another summarization system with two modules using empirical knowledge. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-225-5-234.

Nakao, Y. How small distinction among summaries can the evaluation method identify?. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-235-5-241.

Hirao, T., Hatayama, M. Yamada, S., Takeuchi, K. Text Summarization based on Hanning window and dependency structure analysis. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-242-5-247.

Kameda, M. Modified Key-Sentence Extraction by RICOH at NTCIR-2 TSC. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-248-5-253.

Oka, M., Ueda, Y. Phrase-representation Summarization Method and Its Evaluation. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization. Tokyo. Japan. March 2001. p.5-254-5-261.

Nakao, Y. Effectiveness of an IR-based Evaluation Method for Text Summarization. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.113-120.

Hirao, T, Maeda, E., Matsumoto, Y. Sentence Extraction Based on Support Vector Machines. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.121-127.

Ohtake, K., Okamoto, D., Kodama, M., Masuyama, S. A Summarization System YELLOW for Japanese Newspaper Articles. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.129-136.

Takeuchi, K., Matsumoto, Y. Acquisition of Sentence Simplification Rules for Improving Quality of Text Summaries. IPSJ SIG Notes. Vol. 2001, No. 74, 2001-FI-63. July 24$B!&(B25, 2001. p.137-144.

Kiyonori Ohtake, Daigo Okamoto,Mitusru Kodama,Shigeru Masuyama . Summarization System YELLOW for Japanese Newspaper Articles IPSJ Transactions on Databases Vol．43，ＮｏＳＩＧ２（TOD13）pｐ。37-47march.2002

Kiyonori Ohtake, Daigo Okamoto,Mitusru Kodama,Shigeru Masuyama. A Summarization System YELLOW for Japanese Newspaper Articles IPSJ SIG Notes 63-17、pｐ。129-136、2001/07/25

Hiroyuki SAKAI, Shigeru, MASUYAMA.Unsupervised Acquisition bout the abbreviation possibility of double (multiplex)verb/nou phrases Notes of Information Processing Society of Japan.NL-150，p.179-184,2002/７/16

Studies using NTCIR-3 SUMM2 (Preliminary version)

Seki, Y, Harada, K, Nomura, N. Multi Resource Summarization System with Ruby. In the Special Interest Group Notes of Information Processing Society of Japan. Vol. 2002, No. 28, 2002-DD-32, 2002-FI-66. March, 2002. p.47-54.

Seki, Y. Summarization-Based Japanese Question and Answering System from Newspaper Articles. Proceedings of LREC2002 Q&A Workshop. LAS PALMAS, CANARY ISLANDS, SPAIN. May 2002. The University of Las Palmas de Gran Canaria, Facultad de Informatica. (to appear)

Shinmori,A., Okumura,M., Maruyama,Y., Iwayama,M. "Patent Claim Processing for Readability - Structure Analysis and Term Explanation -", ACL-2003 Workshop on Patent Corpus Processing, Association for Computational Linguistics, 2003. pp.56-65.

Iwayama, M., Fujii, A., Kando, N., Marukawa, Y. An Empirical Study on Retrieval Models for Different Document Genres: Patents and Newspaper Articles. Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, p.251-258, 2003.

Studies using NTCIR-3 WEB

Fujii,A., Itou,K., Akiba,T., Ishikawa.T. A Cross-media Retrieval System for Lecture Videos. Proceedings of the 8th European Conference on Speech Communication and Technology (Eurospeech 2003). Geneva. Sep, 2003. pp.1149-1152

Fujii,A., Itou,K. Building a Test Collection for Speech-Driven Web Retrieval. Proceedings of the 8th European Conference on Speech Communication and Technology (Eurospeech 2003). Geneva. Sep, 2003. pp.1153-1156

Itou, K., Fujii, A. Speech-Driven Web Retrieval Task in the NTCIR-3 Workshop. SIGNotes Spoken Language Processing. 2002-SLP-43. pp.25-32.

Kando, N. Overview of the Third NTCIR Workshop. Working notes of the Third NTCIR Workshop Meeting. PartI:Overview. Tokyo. Japan. October 2002. p.1-16

Harman, D. QA at TREC and Summarization at Duc. Working notes of the Third NTCIR Workshop Meeting PartI:Overview. Tokyo. Japan. October 2002. p17-19.

Shinghal, A. Web IR Research: Can we do without the data?. Working notes of the Third NTCIR Workshop Meeting. PartI:Overview. Tokyo. Japan. October 2002. p.21

Iwayama, M., Fujii, A., Kando, N., Takano, A. Overview of Patent Retrieval Task at NTCIR-3. Working notes of the Third NTCIR Workshop Meeting PartI: Overview. Tokyo. Japan. October 2002. p67-76.

Fukumoto, J., Kato, T., MASUI, F. Question Answering Challenge (QAC-1) Question answering evaluation at NTCIR Workshop 3. Working notes of the Third NTCIR Workshop Meeting. PartI: Overview. Tokyo. Japan. October 2002. p77-86.

FUKUSIMA, T., OKUMURA, M., NANBA, H. Text summarization Challenge 2 Text summarization evaluation at NTCIR Workshop3. Working notes of the Third NTCIR Workshop Meeting. PartI: Overview. Tokyo. Japan. October 2002. p87-91

Eguchi, K., Oyama, K., Ishida, E., Kando, N., Kuriyama, K. Overview of Web Retrieval Task at the Third NTCIR Workshop. Working notes of the Third NTCIR Workshop Meeting. PartI: Overview. Tokyo. Japan. October 2002. p93-116.

Chen, K H., Chen, H H., Kando, N., Kuriyama, K., Lee, S., Myaeng, S H., Kishida, K., Eguchi, K., Kim, H. Overview of CLIR Task at the Third NTCIR Workshop. Working notes of the Third NTCIR Workshop Meeting PartI: Overview. Tokyo. Japan. October 2002. p.23-60. Working notes of the Third NTCIR Workshop Meeting. PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan.October 2002. p1-38.

Lee, S., Myaeng, S H., Kim, H., Seo, J H. Lee, B., Cho, S. Characteristics of the Korean Test Collection for CLIR in NTCIR-3. Working notes of the Third NTCIR Workshop Meeting PartI: Overview. Tokyo. Japan. October 2002. p.61-65. Working notes of the Third NTCIR Workshop Meeting. PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p39-43.

Kwok, K L. Chinese, Cross Language Retrieval Experiments Using PIRCS. Working notes of the Third NTCIR Workshop Meeting. PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p45-50.

Sakai, T., Koyama, M., Suzuki, M., Manabe, T. Toshiba KIDS at NTCIR-3: Japanese and English-Japanese IR. Working notes of the Third NTCIR Workshop Meeting. PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p51-58.

Moulinier, I. Molina-Salgado, H. Jackson, P. Thomson Legal and Regulatory at NTCIR-3. Working notes of the Third NTCIR Workshop Meeting. PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p59-65.

Tomlinson, S. Asian Language Parsing Evaluated by Hummingbird SearchServer at NTCIR-3. Working notes of the Third NTCIR Workshop Meeting. PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p1-38.

Seo, H C., Kim, S B., Kim, B I., Rim, H C., Lee, S Z. KUNLP System for NTCIR-3 English-Korean Cross-Language Information Retrieval. Working notes of the Third NTCIR Workshop Meeting. PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p73-79.

Takeda, Y., Umemura, K., Yamamoto, E. Deciding Indexing Strings with Statistical Analysis., Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p79-85.

Murata, M., Ma, Q., Isahara, H. Applying Multiple Characteristics and Techniques to Obtain High Levels of Performance in Information Retrieval. Working notes of the Third NTCIR Workshop Meeting. PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p87-92.

Luk, R W P., Wong, K F., Kwok, K L. Different Retrieval Models and Hybrid Term Indexing. Working notes of the Third NTCIR Workshop Meeting. PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p93-100.

Lin, W C., Chen, H H. NTU at NTCIR3 MLIR Task. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p101-105.

He, H., Gao, J. NTCIR-3 CLIR Experiments at MSRA. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p107-113.

Yang, Y., Ma, N. CMU in Cross-Language Information Retrieval at NTCIR-3. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p115-119.

Zhang, J., Sun, Le., Qu, W., Lin, D., Sun, Y., Fan, Y., Lin, Z. ISCAS at NTCIR3. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p121-127.

Fujii, A., Ishikawa, T. NTCIR-3 Cross-Language IR Experiments at ULIS. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p128-132.

Donghong, J., Lingpeng, Y., Yu, N. Chinese Language IR based on Term Extraction. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p133-135.

Juang, D H., Tseng, Y H. Uniform Indexing and Retrieval Scheme for Chinese, Japanese, and Korean. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p137-141.

McNamee, P. Knowledge-light Asian Language Text Retrieval at the NTCIR-3 Workshop. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p143-148.

Sato, T., Han, K. NTCIR-3 CLIR Experiments at Osaka Kyoiku University: Comparison of Gram-based Indices. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p149-151.

Kluev, V. OASIS at NTCIR-3: Monolingual IR Task. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p153-158.

Huang, X., Peng, F., Schuurmans, D., Cercone, N. Waterloo at NTCIR-3: Using Self-supervised Word Segmentation. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p159-163.

Lee, C., Lee, S. Lee, G G. POSNIR: Probabilistic Natural Language Information Retrieval System. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p165-171.

Chen, A., Gey, F C. Experiments on Cross-language and Patent Retrieval at NTCIR-3 Workshop. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p173-182.

Jang, M G., Kim, P., Jin, Y., Cho, S H., Myaeng, S H. Simple Query Translation Methods for Korean-English and Korean-Chinese CLIR in NTCIR Experiments. Working notes of the Third NTCIR Workshop Meeting PartII: Cross Lingal Information Retrieval Task. Tokyo. Japan. October 2002. p183-188.

ITOH, H., MANO, H., OGAWA, Y. Term Distillation for Cross-DB Retrieval. Working notes of the Third NTCIR Workshop Meeting. PartIII Patent Retrieval Task. Tokyo. Japan. October 2002. p11-14

KISHIDA, K., Experiment on Pseudo Relevance Feedback Method Using Taylor Formula at NTCIR-3 Patent Retrieval Task. Working notes of the Third NTCIR Workshop Meeting. PartIII Patent Retrieval Task. Tokyo. Japan. October 2002. p.

SATO, T., SATOMOTO, T., HAN, K. NTCIR-3 PAT Experiments at Osaka Kyoiku University -- Long Gram-based Index and Essential Words --Working notes of the Third NTCIR Workshop Meeting. PartIII Patent Retrieval Task. Tokyo. Japan. October 2002. p21-24

Nakatani, Y., Takada, K., Isoda, M., Okumura, M., Iwayama, M., Marukawa, Y., Shinmori, A. NTT DTEC at Patent Retrieval Task. Working notes of the Third NTCIR Workshop Meeting. PartIII Patent Retrieval Task. Tokyo. Japan. October 2002. p25-31.

Niwa, Y., Hisamitsu, T., Nishioka, S., Imaichi, O., Fujio, M. Patent Search: A Case Study of Cross-DB Associative Search. Working notes of the Third NTCIR Workshop Meeting. PartIII Patent Retrieval Task. Tokyo. Japan. October 2002. p33-39.

Fujii, A., Ishikawa, T. NTCIR-3 Patent Retrieval Experiments at ULIS. Working notes of the Third NTCIR Workshop Meeting. PartIII Patent Retrieval Task. Tokyo. Japan. October 2002. p41-46.

Chen, A., Gey, F C. Experiments on Cross-language and Patent Retrieval at NTCIR-3 Workshop. Working notes of the Third NTCIR Workshop Meeting. PartIII Patent Retrieval Task. Tokyo. Japan. October 2002. p47-56.

Sahlgren, M., Hansen, P., Karlgren, J. English-Japanese Cross-lingual Query Expansion Using Random Indexing of Aligned Bilingual Text Data. Working notes of the Third NTCIR Workshop Meeting. PartIII Patent Retrieval Task. Tokyo. Japan. October 2002. p57-60.

Murata, M., Isahara, H. Using the Diff Command in Patent Documents. Working notes of the Third NTCIR Workshop Meeting. PartIII Patent Retrieval Task. Tokyo. Japan. October 2002. p61-68

SHINMORI, A., OKUMURA, M., MARUKAWA, Y. IWAYAMA, M. Rhetorical Structure Analysis of Japanese Patent Claims using Cue Phrases. Working notes of the Third NTCIR Workshop Meeting. PartIII Patent Retrieval Task. Tokyo. Japan. October 2002. p69-76

Akiba, T., Itou, K., Fujii, A., Ishikawa, T. Towards Speech-Driven Question Answering: Experiments Using the NTCIR-3 Question Answering Collection. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p11-15 p11-15

IKENO, A., OHNUMA, H. Oki QA System for QAC-1. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p17-20

Kawahara, D., Kaji, N., Kurohashi, S. Question and Answering System based on Predicate-Argument Matching. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p21-24

KAWATA, K., SAKAI, H., MASUYAMA, S. A question and answering system using newspaper corpus as a knowledge source. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p25-29

Lee, S., Geunbae, G G. Lee. SiteQ/J: A Question Answering System for Japanese. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p31-38

MORI, T., OHTA, T., FUJIHATA, K., KUMON, R. A* Search Algorithm for Question Answering. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p39-46

Murata, M., Utiyama, M., Isahara, H. A Question-Answering System Using Unit Estimation and Probabilistic Near-Terms IR. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p47-54

NOMOTO, M., SATO, M., SUZUKI, H. NTCIR-3 QAC Experiments at Matsushita. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p55-62

Sasaki, Y., Isozaki, H., Hirao, T., Kokuryou, K., Maeda, E. NTT's QA System for NTCIR QAC-1. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p63-70

SEKI, Y. Answer Extraction System by Question Type from Query-Biased Summary for Newspaper Articles. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p71-77

SEKINE, S., SUDO, K., SHINYAMA, Y., NOBATA, C., UCHIMOTO, K., ISAHARA, H. NYU/CRL QA system, QAC question analysis and CRL QA data. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p79-85

TAKAHASHI, T., NAWATA, K., KOUDA, S., INUI, K. Seeking Answers by Structural Matching and Paraphrasing. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p87-94

Takaki, T., Eriguchi, Y. NTT DATA Question-Answering Experiment at the NTCIR-3 QAC. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p95-100

TOMOIKE, T., KAWACHI, T., THAWONMAS, R., SAKAMOTO, A. Article Retrieval and Answer Extraction Exploiting Characteristics in Newspaper Articles for the QAC Task2. Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p101-105

MASUI, F., MIYAGUCHI, M. Mie Univ. QA system for QAC-1.Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p107-111

FUKUMOTO, J., ENDO, T., NIWA, T. RitsQA: Ritsumeikan question answering system used for QAC-1.Working notes of the Third NTCIR Workshop Meeting. PartIV: Question Answering Challenge. Tokyo. Japan. October 2002. p113-116

FUKUSIMA,T., OKUMURA,M., NANBA,H. Text summarization Challenge 2 Text summarization evaluation at NTCIR Workshop3. Working notes of the Third NTCIR Workshop Meeting. Part V: Text Summarization Challenge2. Tokyo. Japan. October 2002. p1-5

FUKUMOTO, J. Text summarization based on itemized sentences and similar parts detection between documents Working notes of the Third NTCIR Workshop Meeting. Part V: Text Summarization Challenge2. Tokyo. Japan. October 2002. p7-12

HIRAO,T., TAKEUCHI, K., ISOZAKI,H., SASAKI,Y., MAEDA, E. NTT/NAIST's Text Summarization Systems for TSC-2 Working notes of the Third NTCIR Workshop Meeting. Part V: Text Summarization Challenge2. Tokyo. Japan. October 2002. p13-18

ISHIKAWA, K., ANDO, S., DOI, S., OKUMURA, A. Trainable Automatic Text Summarization Using Segmentation of Sentence Working notes of the Third NTCIR Workshop Meeting. Part V: Text Summarization Challenge2. Tokyo. Japan. October 2002. p19-24

MORI, T., SASAKI, T. Information Gain Ratio meets Maximal Marginal Relevance - A method of Summarization for Multiple Documents - Working notes of the Third NTCIR Workshop Meeting. Part V: Text Summarization Challenge2. Tokyo. Japan. October 2002. p25-32

NOBATA, C., SEKINE, S., UCHIMOTO, K. ISAHARA, H. TOMOBE, H., ISHIZUKA, M. A summarization system with categorization of document sets Working notes of the Third NTCIR Workshop Meeting. Part V: Text Summarization Challenge2. Tokyo. Japan. October 2002. p33-38

OKAZAKI, N., MATSUO, Y., MATSUMURA, N., Two Different Summarization Method at NTCIR3-TSC2: Coverage Oriented and Focus Oriented Working notes of the Third NTCIR Workshop Meeting. Part V: Text Summarization Challenge2. Tokyo. Japan. October 2002. p39-46

SAKAI, H., MASUYAMA, S. Unsupervised Acquisition of knowledge about the abbreviation possibility of some of multiple phrases modifying the same verb/noun Working notes of the Third NTCIR Workshop Meeting. Part V: Text Summarization Challenge2. Tokyo. Japan. October 2002. p47-54

SEKI, Y. Sentence Extraction by tf/idf and Position Weighting from Query-Biased Summary for Newspaper Articles Working notes of the Third NTCIR Workshop Meeting. Part V: Text Summarization Challenge2. Tokyo. Japan. October 2002. p55-59

Eguchi, K., Oyama, K., Ishida, E., Kando, N., Kuriyama, K. Overview of Web Retrieval Task at the Third NTCIR Workshop Working notes of the Third NTCIR Workshop Meeting. Part VI: Web Retrieval Task. Tokyo. Japan. October 2002. p1-24

KAWAI, H., AKAMINE, S., MATSUDA, K., FUKUSHIMA, T. Evaluation of Web Retrieval Methods Using Anchor Text Working notes of the Third NTCIR Workshop Meeting. Part VI: Web Retrieval Task. Tokyo. Japan. October 2002. p25-29

TOYODA, M., KITSUREGAWA, M., MANO, H., ITOH, H., OGAWA, Y. University of Tokyo/RICOH at NTCIR-3 Web Retrieval Task Working notes of the Third NTCIR Workshop Meeting. Part VI: Web Retrieval Task. Tokyo. Japan. October 2002. p31-38

OZAKU, H.i., UTIYAMA, M., ISAHARA, H., KONO, Y., KIDODE, M. Study of Merging with Multiple Results of Information Retrieval System Working notes of the Third NTCIR Workshop Meeting. Part VI: Web Retrieval Task. Tokyo. Japan. October 2002. p39-46

Kluev, V. Web Search Experiments Using OASIS Working notes of the Third NTCIR Workshop Meeting. Part VI: Web Retrieval Task. Tokyo. Japan. October 2002. p47-49

SATO, T., KYO, Y., KOBATA, K. WEB Experiments at Osaka Kyoiku University -- Towards Index Patitioning and Parallel Retrieval -- Working notes of the Third NTCIR Workshop Meeting. Part VI: Web Retrieval Task. Tokyo. Japan. October 2002. p51-54

Fujii, A., Itou, K. Evaluating Speech-Driven IR in the NTCIR-3 Web Retrieval Task Working notes of the Third NTCIR Workshop Meeting. Part VI: Web Retrieval Task. Tokyo. Japan. October 2002. p55-61

Okazaki,N., Mastuo Y., Mastumura, N., Ishizuka, M., Sentence Extraction by Spreading Activation with Refined Similarity Measure. IEICE Transactions on Information and Systems, submitting.

Okazaki,N., Mastuo Y., Mastumura, N., Tomobe., H, Ishizuka, M., Extracting Characteristic Sentences from Related Documents. In Proc. of 6th Int'l Conf. on Knowledge-based Intelliegnt Information Engineering Systems andApplied Technologies(KES2002) , IOS Press/Ohmsha (ISSN:0922-6389), Crema, Italy, pp.1257-1261, (2002.9)

Okazaki,N., Mastuo Y., Mastumura, N., Ishizuka, M., Sentence Extraction by Spreading Activation with Refined Similarity Measure. The 16th International FLAIRS Conference, to appear in May 2003.

Itou, K., Fujii, A., Ishikawa, T. LANGUAGE MODELING FOR MULTI-DOMAIN SPEECH-DRIVEN TEXT RETRIEVAL

Nanba,H and Okumura ,M. Comparison of Some Automatic amd Manual Methods for Evaluation Based on the Text Summarization Challenge2 In Proceedings of the 4th International Conference on Language Resources and Evakuation (LREC2004),pp.1029-1032

Okazaki,N., Mastuo Y., Mastumura, N., Ishizuka, M., Sentence Extraction by Spreading Activation with Refined Similarity Measure. The 16th International FLAIRS Conference, to appear in May 2003.

Hiroyuki Sakai,Shigeru Masuyama,,IEICE Transactions on Information and Systems,Vol.E86-D,No,pp.1710-1718,2003 A satistical method for acquiring Knowledge about the abbreviation possibility of multiple phrase ,IEICE Transactions on Information and Systems,Vol.E86-D,No,pp.1710-1718,2003

Tatsumi Yoshida,Shigeru Masuyama, Multiple summarization system GOLD ,IEICE Transactions on Information and Systems,Vol.E86-D,No,pp.1719-1727,2003

Akihiro Niimura,　Manabu Okumura An Approach to Reading Support System for Patent Specifications the Papers of technical Meeting on Information System,IEE Japan IS-04-47(2004/9)

Shigeo Matusmura ,Koichi Yamada, hiroshi Kinukawa, Hiroshi Nakagawa Sentence extraction using the similarity between title and sentence and the relative position of sentence In Proceedings of the 11th Annual Meeting of the Association for Natural Language Processing March,2005、p640-643

Kou TAKAHASHI,Takao MIURA, Isamu SHIOYA Clustering Web Documents Based on Correlation of Hyperlinks International Special Workshop On Data bases For Next Generation Researchers (SWOD2005)In Memoriam of Prof. Kambayashi in conjuction with ICDE 2005, Session 1:Data Maining and Clustering

Hirohito OHUCHI,Takao MIURA, Isamu SHIOYA Document Retrieval by Projection Based Frequency Distribution In Workshop on the Institute of Electronics, Information and Communication Engineers. Session 1C (Information Retrieval Clustering)C-i8（2005)

Kazuhiro Shimizu, Takao Miura Disjunctive Sequential Patterns on Single Data Sequence and its Anti-Monotonicity In Workshop on the Institute of Electronics, Information and Communication Engineers. Session 3C (Data mining Clustering Extracting of Information)3C-i8(2005)

Fujii, A., Noriko, K., Iwayama,M. Building a Test Collection for Associative Patent Retrieval in NTCIR-4. IPSJ SIG Technical Reports 2004-NL-159. pp.45-52.

Fujii, A., Iwayama,M., and Noriko, K. Test Collections for Patent-to-Patent Retrieval and Patent Map Generation in NTCIR-4 Workshop.Proceedings of the 4th International Conference on Language Resources and Evaluation, pp.1643-1646, May. 2004.

Atsushi Fujii, Makoto Iwayama, and Noriko Kando. The Patent Retrieval Task in the Fourth NTCIR Workshop. Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp.560-561, Jul. 2004.

Myaeng,S.H>.et al.(Eds) AIRS 2004, Lecture Notes in Computer Science 3411,pp.251-262,Springer-Verlaｇ,2005

Sakai,T Ranking the NTCIR Ststems based on Multigarade Relevance, AIRS 2004 Proceedings.pp.170-177,2004.

Sakai,T.,Saito, Y.,Ichimura,Y.,Kokubu,T.,and Koyama,M. The Effect of Back-Formulating Questions in Qyestion Answering Evaluation, ACM SIGIR 2004 Proceedings,pp474-475,2004.

Sakai,T New Performance Metrics based on Multigrade Relevance:Their Application to Quwstion Answering, NTCIR-4 Proceedings,to appear,2004.

Sakai,T.,Saito, Y.,Ichimura,Y., Koyama,M. and Kokubu,T. Toshiba ASKMi at NTCIR-4 QAC2 NTCIR-4 Proceedings,to appear,2004.

Sakai,T,.Koyama,M.,Kumno,A. and Manabe,T.:Toshiba BRIDJE at Ntcir-4CLIR Monoliguak/Bilingual IR and Flexible Feedback, NTCIR-4 Proceedings,to appear, 2004.

Sakai,. Saito,ay.,Ichimura,Y.,Koyama,M.,Kokubu,T., and Manabe,T. ASKMi:A Japanese Qusetion Answering System based on Semantic Role Analysis,RIAO 2004 proceedings, pp215-231,2004.

Okazaki,N., Matsuo,Y. and Ishizuka,M. Improving Chronological Sentence Ordering by Procedence Relation in 20th International Conference on Computational Linguistics(COLING 04), pp. 750756, Geneva,Swiss(2004)

Okazaki,N., Matsuo,Y. and Ishizuka,M. Coherent Arrangement of SentencesExtracted fron Multiple Newspaper Articles in PRICAI 2004 : Trends in artificial intelligence: 8th Pacific Rim Imternational Conference on artficial Intelligence Lecture Notes in Computer Science,LNCS 3157 /2004, pp. 882-891, Aukland, New Zealand (2004),Springer

Okazaki,N., Matsuo,Y. and Ishizuka,M. Coherent Arrangement of Sentences Extracted fron Multiple Newspaper Articles in PRICAI 2004 : Pre-Conference Workshop Notes(Workshop of Language Sense on Computer), Auckland, New Zealand (20024)

Okazaki,N., Matsuo,Y ., Matsumura ,N.,and Ishizuka,M. Sentence Extraction by Spreading Activation with Similarity Measure, IEICE Transaction on Information and Systems (Special Issue on Text Processing for Information Access)Vol. E86-D, No 9, pp. 915-926(2003)

Tatsunori Mori, Tomoharu Ohta, Katsuyuki Fujihata, and Ryutaro Kumon. An A* Search in Sentential Matching for Question Answering. IEICE Transactions on Information and Systems, Vol. E86-D, No. 9, pp. 1658-1668 (2003).

Tatsunori Mori. Japanese Q/A System using A* Search and Its Improvement. In Working Notes of the Fourth NTCIR Workshop Meeting, pp. 345-352 (2004).

Tatsunori Mori, Masanori Nozawa, and Yoshiaki Asada. Multi-Document Summarization Using a Question-Answering Engine. In Working Notes of the Fourth NTCIR Workshop Meeting, pp.422--429 (2004)

Tatsunori Mori, Masanori Nozawa, and Yoshiaki Asada. Multi-Answer-Focused Multi-Document Summarization Using a Question-Answering Engine. "In Proceedings of the 20th International Conference on Computational Linguistics (COLING 04), pp.439-445 (2004). "

Tetsu Muramatsu and Tatsunori Mori. Integration of PLSA into Probabilistic CLIR Model. In Working Notes of the Fourth NTCIR Workshop Meeting, pp.166-171 (2004).

Kato,T., Fukumoto,J. and Masui,F Question Answering Challenge for Information Access Dialogue Overview of NTCIR4 Subtask3 In Woking Notes of the Fourth NTCIR Workshop Meeting (NTCIR4), pp.291-297, 2004.6

Kato,T., Fukumoto,J. and Kand,N. Handling Information Access Dialogue through QATechnologies/A novel challenge for open-domain question answering .3In Proceedings of the Workishop onPragmatics of Queation Answering at HLT-NAAL2004, pp70-77,2004

Hidaka,N., and masui,F., MAIQA: Mie Univ. Participated System at NTCIR4 QAC2 In Woking Notes of the Fourth NTCIR Workshop Meeting (NTCIR4), pp.315-319, 2004.6

Fukumoto,J.,Kato,T.,and Masui,F, An Evaluation oog question answering challenge (QAC-1) at the NTCIR workshopb #, ACM SIGIR Forum ,Vol.38, Ossue 1,pp 25-28, 2004.6.

Fukumoto,J.,Kato,T.,and Masui,F, Question Answering Challenge for Five ranked answers and List answers - Overview of NTCIR4 QAC2 Subtask 1 and 2 In Woking Notes of the Fourth NTCIR Workshop Meeting (NTCIR4), pp.283-290, 2004.6

Hideyuki Uchida, Atsushi Mano and Takashi Yukawa " Map Generation using Concept-based Vector Space Model In Working Notes of the Fourth NTCIR Workshop Meeting, pp.２７７−２８１ (2004).

Isrami Bin Ismail and Takashi Yukawa Question Answering System Using Concept-based Vector Space Model In Working Notes of the Fourth NTCIR Workshop Meeting, pp.320-325 (2004).

Isrami Bin Ismail and Takashi Yukawa Implementation and Evaluation of a Question Answering system usingConcept-based Vector Space Model Proc,Joint 2nd International Conference of Soft Computing and Intelligent Systems and 5th International Symposium on Advanced Intelligent System(2004)

M.Nonoto NTCIR-4 QAC Experiments at Matsushita In Working Notes of the Fourth NTCIR Workshop Meeting, pp. (2004).

M.Nonoto Are We Making Progress?/An Analysis of QAC1 and " Proceedings of the Fourth NTCIR Workshop Meeting, pp. (2004).

M.Nonoto NTCIR-4 QAC Experiments at Matsushita Proceedings of the Fourth NTCIR Workshop Meeting, pp. (2004).

Y,Fukushige Giving an Upperbound of number of Clusters and Relevant.Words in Hierarchical Document Clustering Based on BIC In Proceedingsof the Fourth NTCIR Workshop Meeting, pp. (2004).

Sumio FUJITA Revisiting Again Document Length Hypotheses TREC 2004 Genomics Track Experiments at Patolis NIST Special Publication:SP 500-261,The Thirteenth Text Retrieval Conference(TREC 2004)

Keizo Oyama, Haruko Ishikawa, Koji Eguchi, Akiko Aizawa, The test collection for navigational retrieval on WWW data-Design and characteristics, Progress in Informatics, 59-74p, No.1, March 2005

Koji Eguchi, Keizo Oyama, Emi Ishida, Noriko Kando, and Kazuko Kuriyama, An Evaluation of the Web Retrieval Task at the Third NTCIR Workshop ACM SIGIR Forum, Vol.38, No.1, pp.39-45 (Jun. 2004).

Koji Eguchi, Keizo Oyama, Akiko Aizawa, and Haruko Ishikawa, ``Overview of WEB Task at the Fourth NTCIR Workshop'', Proceedings of the Fourth NTCIR Workshop on Research in Information Access Technologies: Tokyo, Japan (Jun. 2004).

Koji Eguchi, Keizo Oyama, Akiko Aizawa, and Haruko Ishikawa, `Overview of the Informational Retrieval Task at NTCIR-4 WEB'', Proceedings of the Fourth NTCIR Workshop on Research in Information Access Technologies: Tokyo, Japan (Jun. 2004).

Takashi Ohtsuka, Koji Eguchi, and Hayato Yamana, An Evaluation Method of Web Search Engines based on Users' Sense, Proceedings of the Fourth NTCIR Workshop on Research in Information Access Technologies: Tokyo, Japan (Jun. 2004).

Koji Eguchi, Overview of the Topical Classification Task at NTCIR-4 WEB, Proceedings of the Fourth NTCIR Workshop on Research in Information Access Technologies: Tokyo, Japan (Jun. 2004).

Keizo Oyama, Koji Eguchi, Haruko Ishikawa, and Akiko Aizawa, Overview of the NTCIR-4 WEB Navigational Retrieval Task 1 Proceedings of the Fourth NTCIR Workshop on Research in Information Access Technologies: Tokyo, Japan (Jun. 2004).

Tsuneaki Kato, Jun'ichi Fukumoto, Fumito Masui and Noriko Kando: Handling Information Access Dialogue through QA Technologies-- A novel challenge for open-domain question answering --, Proceedings of HLT-NAACL2004 Workshop on Pragmatics of Question Answering, pp. 70-77, 2004.5

Katunobu Itou, Atsushi Fujii "Adapting Language Models for Frequent Fixed Phrases by Emphasizing N-Gram Subsets. " Proceedings of Eurospeech 2003, pp.1469-1472, 2003.

Tomoyosi Akiba, Atsushi Fujii, Katunobu Itou Collecting Spontaneously Spoken Queries for Information Retrieval Proceedings of 4th International Conference on Language Resources and Evaluation, pp.1439-1442, 2004.

Tomoyosi Akiba, Atsushi Fujii, Katunobu Itou Effects of Language Modeling on Speech-driven Question Answering Proceedings of International Conference on Spoken Language Processing,pp.1053-1056, 2004.

Hiroyuki SAKAI,Sigeru MASUYAMA， A Multiple-Document Summarization System withe User Interaction　， proceedings of Coling2004,Vol.�U,pp.1001-1007,August 23-27,2004.

Hideki　Isozaki NTT’s Question Answering System for NTCIR QAC2 In Working Notes of the Fourth NTCIR Workshop Meeting, pp. (2004).

Sakai,T　On the Stabiliti of Ranking System at Evaluation Workshops　In Workshop on the 11th Annual Meeting of the Association for Natural Language Processing　2005

Sakai,T A Note on the Reliability of Japanese Question Answering Evaluation, Interest Group Notes of Information Processing Society of Japan FI−７７−７．p57-64/Digital Libraries No２５＆26ｐｐ59-56，2004

Sakai,T.,Saito, Y.,Kokubu,T,Koyama,M. and　Manabe,T. High-Precision Search via Question Abstraction for Iapanese Question Aｎswering,　 Interest Group Notes of Information Processing Society of Japan FI-76-19/NL-163-19,pp139-146，

Yumi ICHIMURA ,Yoshimi SAITO, Tetsuya SAKAI, Tomoharu KOKUBU,Makoto Koyama.The Effect of Japanese Namrd Entitty Extraction and Answer Type Taxonomy on the Performance of a Question Answering System IEICE transaction vol.J88-D11,2005

Sakai,T.,Saito, Y.,Kokubu,T,Koyama,M. and　Manabe,T. Interest Group Notes of Information Processing Society of JapanNL-161-3,2004.

Bollegala,D.,Okazaki,N. Ishizuka,M A Machin Learning Approch to Sentence Ordering for Multidocument Summarization, In the proceedings of the 67st National Convention of IPSJNo.5J-3 ,2005

Bollegala,D.,Okazaki,N. Ishizuka,M A Machin Learning Approch to Sentence Ordering for Multidocument Summarization, In Proceedings of the 11th Annual Meeting of the Association for Natural Language Processing　No.D3-6 ,2005

Naoaki Okazaki ,Mitsuru Ishizuka An Investigation of Sentence Ordering Extracted from Multiple Newspaper Articles In Proceedings of the 18th Annual Confernce of Japanese Society for Artificial IntelligenceN0 2G-04 (2004)

Naoaki Okazaki, Yutaka Matsuo, Mitsuru Ishizuka Extracting Textual Units from Multi-documents In the First Forum on Information Technology　No. E-2　（FIT２００２）

Akihiro Niimura,　Manabu Okumura Aligning Patent Claims In Working Notes of the Fourth NTCIR Workshop Meeting, pp. (2004).

Watanabe Shuuji, Kimura Makoto, Hisamitu Toru, Kinukawa Hiroshi .Theme Characterized Term Weighting Method and Its Application to Single Document SummarizationIn the 3rd Forum on Information Technology(FIT2004)vol2.Sep.2004 p.173-174

Shigeo Matusmura ,Koichi Yamada, hiroshi Kinukawa, Hiroshi Nakagawa. Sentence extraction using the common sentence of newspaper articles In the 3rd Forum on Information Technology(FIT2004)vol2.Sep.2004 p.171-172

KAWAI, H., AKAMINE, S., MATSUDA, K., FUKUSHIMA, T. Evaluation of Web Retrieval Methods Using Anchor Text Working notes of the Third NTCIR Workshop Meeting. Part VI: Web Retrieval Task. Tokyo. Japan. October 2002. p25-29

Xinghui Xu,kyoji Umemura Optimal Local Dimention Analysis of Latent Semantic Indexing on Query neighbor Space IEICE Trnansaction on Information and Systems,Vol E86-D No.9 Sep.,pp.1762-1772,2003

Xinghui Xu,kyoji Umemura AS Unified Model of Literal Mining and Link Analysis for Ranking Web Resouces SIGIR 2004 ,pp.546-547,2004

Xinghui Xu,kyoji Umemura Web Searching Using Term Entropy pn Virtual Document and Query Independent Importance in NTCIR-4 Web Task NTCIR Workshop 4 Meeting vol 1 pp/1-8 2004 ACM SIGIR Conference on Research and Development in Information Retrieval,

ntc-admin
2005-08-29