People_

Dr Jonathan Kummerfeld

Senior Lecturer
School of Computer Science

Email

jonathan.kummerfeld@sydney.edu.au

Address

J12 - Computer Science Building

The University of Sydney

Websites

School of Computer Science

Resume

Jonathan K. Kummerfeld is a Senior Lecturer (ie., research tenure-track Assistant Professor) in the School of Computer Science at the University of Sydney. He works on Natural Language Processing, with a particular focus on systems for collaboration between people and AI models, including in dialogue and crowdsourcing.

Research interests

Jonathan K. Kummerfeld works on making computers capable of understanding language and using that ability to collaborate with people more effectively. This involves solving challenges in Artificial Intelligence and Human-Computer Interaction.

"My research projects fall into three core areas:

Interactive Executable Semantic Parsing - Developing systems that can take complex actions in response to user requests. For example, a person asks for information and the system queries a database to provide an answer, which involves accurately interpreting the request and determining the best way to present the answer.

Data Science - Making it possible to use NLP technology to analyse new forms of data, broadening the range of questions we can answer. Real-world data is messier than the benchmarks used in most NLP research, posing new challenges for our methods.

Communication and Collaboration - Exploring how AI systems can be active collaborators with people. For example, by building bots to play the board game Diplomacy, in which players chat to negotiate alliances, strategies, and tactics.

Solving these challenges involves innovation in (1) AI models, including neural networks, (2) data creation methods, such as crowdsourcing, and (3) research methodology, e.g., metrics for performance."

Teaching and supervision

COMP5046: Natural Language Processing

Current research students

Project title	Research student
Answerability, Calibration and Grounding Guarantees for Natural Language Question Answering	Kent O'SULLIVAN

Publications

By Type

Expand all

Book Chapters

Gunasekara, C., Kummerfeld, J., Polymenakos, L., Lasecki, W. (2019). DSTC7 Task 1: Noetic End-to-End Response Selection. Dialog System Technology Challenges at AAAI 2019, (pp. 60-67). Florence, Italy: Association for Computational Linguistics (ACL). [More Information]

Journals

Kim, S., Galley, M., Gunasekara, C., Lee, S., Atkinson, A., Peng, B., Schulz, H., Gao, J., Li, J., Adada, M., et al (2021). Overview of the Eighth Dialog System Technology Challenge: DSTC8. IEEE/ACM Transactions on Audio Speech and Language Processing, 29, 2529-2540. [More Information]
Burdick, L., Kummerfeld, J., Mihalcea, R. (2021). To Batch or Not to Batch? Comparing Batching and Curriculum Learning Strategies across Tasks and Datasets. Journal of Mathematics, 9(18).
Burdick, L., Kummerfeld, J., Mihalcea, R. (2021). To batch or not to batch? Comparing batching and curriculum learning strategies across tasks and datasets. Mathematics, 9(18). [More Information]
D'Haro, L., Yoshino, K., Hori, C., Marks, T., Polymenakos, L., Kummerfeld, J., Galley, M., Gao, X. (2020). Overview of the seventh Dialog System Technology Challenge: DSTC7. Computer Speech and Language, 62, 101068-1-101068-21. [More Information]
Welch, C., Perez-Rosas, V., Kummerfeld, J., Mihalcea, R. (2019). Learning from Personal Longitudinal Dialog Data. IEEE Intelligent Systems, 34(4), 16-23. [More Information]
Kummerfeld, J., Klein, D. (2017). Parsing with Traces: An O(n4) Algorithm and a Structural Representation. ACL Anthology, 5, 441-454. [More Information]
Moss, V., McClure-Griffiths, N., Murphy, T., Pisano, D., Kummerfeld, J., Curran, J. (2013). High-Velocity Clouds in the Galactic All Sky Survey. I. Catalog. The Astrophysical Journal Supplement Series, 209(1), 1-18. [More Information]
Candelier, R., Widmer-Cooper, A., Kummerfeld, J., Dauchot, O., Biroli, G., Harrowell, P., Reichman, D. (2010). Spatiotemporal hierarchy of relaxation events, dynamical heterogeneities, and structural reorganization in a supercooled liquid. Physical Review Letters, 105(13), 135702-1-135702-4. [More Information]
Kummerfeld, J., Hudson, T., Harrowell, P. (2008). The Densest Packing of AB Binary Hard-Sphere Homogeneous Compounds across all Size Ratios. The Journal of Physical Chemistry B, 112(35), 10773-10776. [More Information]

show 6 more

Conferences

Jiang, Y., Zhu, H., Kummerfeld, J., Li, Y., Lasecki, W. (2022). A Novel Workflow for Accurately and Efficiently Crowdsourcing Predicate Senses and Argument Labels. Findings of the Association for Computational Linguistics, United States: Association for Computational Linguistics (ACL).
Kummerfeld, J. (2022). Leveraging Similar Users for Personalized Language Modeling with Limited Data. 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers, United States of America: Association for Computational Linguistics (ACL).
Kummerfeld, J., Bansal, M., Burkett, D., Klein, D. (2022). Mention Detection: Heuristics for the OntoNotes annotations. 15th Conference on Computational Natural Language Learning, Stroudsburg, Pennsylvania, United States: Association for Computational Linguistics (ACL).
Burdick, L., Kummerfeld, J., Mihalcea, R. (2022). Using Paraphrases to Study Properties of Contextual Embeddings. 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, United States of America: Association for Computational Linguistics (ACL).
Burdick, L., Kummerfeld, J., Mihalcea, R. (2021). Analyzing the Surprising Variability in Word Embedding Stability Across Languages. 2021 Conference on Empirical Methods in Natural Language Processing, Dominican Republic: Empirical Methods in Natural Language Processing.
Lahnala, A., Kambhatla, G., Peng, J., Whitehead, M., Minnehan, G., Guldan, E., Kummerfeld, J., Camcı, A., Mihalcea, R. (2021). Chord Embeddings: Analyzing What They Capture and Their Role for Next Chord Prediction and Artist Attribute Prediction. 10th International Conference on Artificial Intelligence in Music, Sound, Art and Design, Online: Springer. [More Information]
Huffaker, J., Kummerfeld, J., Lasecki, W., Ackerman, M. (2021). Crowdsourced Detection of Emotionally Manipulative Language. 2020 ACM CHI Conference on Human Factors in Computing Systems (CHI EA 2020), Honolulu: Association for Computing Machinery (ACM). [More Information]
Kummerfeld, J., Klein, D. (2021). Error-Driven Analysis of Challenges in Coreference Resolution. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Washington: Association for Computational Linguistics (ACL).
Lahnala, A., Zhao, Y., Welch, C., Kummerfeld, J., An, L., Resnicow, K., Mihalcea, R., Perez-Rosas, V. (2021). Exploring Self-Identified Counseling Expertise in Online Support Forums. Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, United States: Association for Computational Linguistics (ACL). [More Information]
Rajendran, J., Kummerfeld, J., Singh, S. (2021). Learning to Learn End-to-End Goal-Oriented Dialog From Related Dialog Tasks. 3rd Workshop on Natural Language Processing for Conversational AI, NLP4ConvAI 2021, United States: Association for Computational Linguistics (ACL).
Lee, A., Kummerfeld, J., An, L., Mihalcea, R. (2021). Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Health. 2021 Findings of the Association for Computational Linguistics, Findings of ACL: EMNLP 2021, United States: Association for Computational Linguistics (ACL).
Larson, S., Mahendran, A., Lee, A., Kummerfeld, J., Hill, P., Laurenzano, M., Hauswald, J., Tang, L., Mars, J. (2021). Outlier Detection for Improved Data Quality and Diversity in Dialog Systems. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minnesota: Association for Computational Linguistics (ACL). [More Information]
Kummerfeld, J. (2021). Quantifying and Avoiding Unfair Qualification Labour in Crowdsourcing. Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL-IJCNLP 2021, Online: The Association for Computational Linguistics.
Welch, C., Kummerfeld, J., Perez-Rosas, V., Mihalcea, R. (2020). Compositional Demographic Word Embeddings. 2020 Conference on Empirical Methods in Natural Language Processing, United States: Association for Computational Linguistics (ACL).
Welch, C., Kummerfeld, J., Perez-Rosas, V., Mihalcea, R. (2020). Exploring the Value of Personalized Word Embeddings. Proceedings of the 28th International Conference on Computational Linguistics, United States: International Committee on Computational Linguistics. [More Information]
Welch, C., Mihalcea, R., Kummerfeld, J. (2020). Improving Low Compute Language Modeling with In-Domain Embedding Initialisation. 2020 Conference on Empirical Methods in Natural Language Processing, United States: Association for Computational Linguistics (ACL).
Larson, S., Cheung, A., Mahendran, A., Leach, K., Kummerfeld, J. (2020). Inconsistencies in Crowdsourced Slot-Filling Annotations: A Typology and Identification Methods. Proceedings of the 28th International Conference on Computational Linguistics, United States: International Committee on Computational Linguistics. [More Information]
Larson, S., Zheng, A., Mahendran, A., Tekriwal, R., Cheung, A., Guldan, E., Leach, K., Kummerfeld, J. (2020). Iterative Feature Mining for Constraint-Based Data Collection to Increase Data Diversity and Model Robustness. 2020 Conference on Empirical Methods in Natural Language Processing, United States: Association for Computational Linguistics (ACL).
Kummerfeld, J., Gouravajhala, S., Peper, J., Athreya, V., Gunasekara, C., Ganhotra, J., Patel, S., Polymenakos, L., Lasecki, W. (2019). A Large-Scale Corpus for Conversation Disentanglement. 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019), Stroudsburg: Association for Computational Linguistics (ACL). [More Information]
Larson, S., Mahendran, A., Peper, J., Clarke, C., Lee, A., Hill, P., Kummerfeld, J., Leach, K., Laurenzano, M., Tang, L., et al (2019). An Evaluation for Intent Classification and Out-of-Scope Prediction. 2019 Conference on Empirical Methods in Natural Language Processing, Hong Kong: Association for Computational Linguistics (ACL). [More Information]
Welch, C., Perez-Rosas, V., Kummerfeld, J., Mihalcea, R. (2019). Look Who's Talking: Inferring Speaker Attributes from Personal Longitudinal Dialog. 20th International Conference on Computational Linguistics and Intelligent Text Processing, La Rochelle, France: Springer.
Paquette, P., Lu, Y., Bocco, S., Smith, M., Ortiz-Gagne, S., Kummerfeld, J., Singh, S., Pineau, J., Courville, A. (2019). No press diplomacy: Modeling multi-agent gameplay. Advances in Neural Information Processing Systems 32: 33rd Annual Conference on Neural Information Processing Systems 2019, San Diego, USA: Neural Information Processing Systems (NIPS).
Kummerfeld, J. (2019). SLATE: A Super-Lightweight Annotation Tool for Experts. 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019), Stroudsburg: Association for Computational Linguistics (ACL). [More Information]
Kang, Y., Zhang, Y., Kummerfeld, J., Tang, L., Mars, J. (2018). Data Collection for a Production Dialogue System: A Startup Perspective. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3, New Orleans - Louisiana: Association for Computational Linguistics (ACL). [More Information]
Jiang, Y., Finegan-Dollak, C., Kummerfeld, J., Lasecki, W. (2018). Effective crowdsourcing for a new type of summarization task. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3, New Orleans - Louisiana: Association for Computational Linguistics (ACL).
Wendlandt, L., Kummerfeld, J., Mihalcea, R. (2018). Factors Influencing the Surprising Instability of Word Embeddings. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3, New Orleans - Louisiana: Association for Computational Linguistics (ACL).
Finegan-Dollak, C., Kummerfeld, J., Zhang, L., Ramanathan, K., Sadasivam, S., Zhang, R., Radev, D. (2018). Improving Text-to-SQL Evaluation Methodology. 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018), Stroudsburg: Association for Computational Linguistics (ACL). [More Information]
Welch, C., Kummerfeld, J., Feng, S., Mihalcea, R. (2018). World Knowledge for Abstract Meaning Representation Parsing. 11th International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki: European Language Resources Association (ELRA).
Durrett, G., Kummerfeld, J., Berg-Kirkpatrick, T., Portnoff, R., Afroz, S., McCoy, D., Levchenko, K., Paxson, V. (2017). Identifying Products in Online Cybercrime Marketplaces: A Dataset for Fine-grained Domain Adaptation. Conference on Empirical Methods in Natural Language Processing, United States: Association for Computational Linguistics (ACL). [More Information]
Portnoff, R., Kummerfeld, J., Afroz, S., Berg-Kirkpatrick, T., Durrett, G., McCoy, D., Levchenko, K., Paxson, V. (2017). Tools for Automated Analysis of Cybercriminal Markets. 26th International World Wide Web Conference (WWW 2017), Perth, WA: Association for Computing Machinery (ACM). [More Information]
Jiang, Y., Kummerfeld, J., Lasecki, W. (2017). Understanding Task Design Trade-offs in Crowdsourced Paraphrase Collection. 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017), Stroudsburg, PA: Association for Computational Linguistics (ACL). [More Information]
Kummerfeld, J., Berg-Kirkpatrick, T., Klein, D. (2015). An Empirical Analysis of Optimization for Max-Margin NLP. 2015 Conference on Empirical Methods in Natural Language Processing, United States of America: Association for Computational Linguistics (ACL).
Kummerfeld, J., Tse, D., Curran, J., Klein, D. (2013). An Empirical Examination of Challenges in Chinese Parsing. 51st Annual Meeting of the Association for Computational Linguistics (ACL 2013), Stroudsburg, PA USA: Association for Computational Linguistics (ACL).
Kummerfeld, J., Hall, D., Curran, J., Klein, D. (2012). Parser Showdown at the Wall Street Corral: An Empirical Investigation of Error Types in Parser Output. Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (emnlp-conll 2012), Stroudsburg, PA: Association for Computational Linguistics (ACL).
Kummerfeld, J., Klein, D., Curran, J. (2012). Robust Conversion of CCG Derivations to Phrase Structure Trees. The 50th Annual Meeting of the Association for Computational Linguistics (ACL 2012), Stroudsburg: Association for Computational Linguistics (ACL).
Kummerfeld, J., Roesner, J., Dawborn, T., Haggerty, J., Curran, J., Clark, S. (2010). Faster Parsing by Supertagger Adaptation. 48th Annual Meeting of the Association for Computational Linguistics (ACL 2010), Sweden: Association for Computational Linguistics (ACL).
Honnibal, M., Kummerfeld, J., Curran, J. (2010). Morphological analysis can improve a CCG parser for English. 23rd International Conference on Computational Linguistics, Beijing, China: Press of Tsinghua University.
Kummerfeld, J., Curran, J., Roesner, J. (2009). Faster parsing and supertagging model extimation. Australasian Language Technology Association Workshop (ALTA 2009), Australia: Australasian Language Technology Association.
Kummerfeld, J., Curran, J. (2008). Classification of Verb-Particle Constructions with the Google Web1T Corpus. Australasian Language Technology Association Workshop 2008 (ALTA), Australia: Australasian Language Technology Association.

show 36 more

By Year

Expand all

2022

Jiang, Y., Zhu, H., Kummerfeld, J., Li, Y., Lasecki, W. (2022). A Novel Workflow for Accurately and Efficiently Crowdsourcing Predicate Senses and Argument Labels. Findings of the Association for Computational Linguistics, United States: Association for Computational Linguistics (ACL).
Kummerfeld, J. (2022). Leveraging Similar Users for Personalized Language Modeling with Limited Data. 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers, United States of America: Association for Computational Linguistics (ACL).
Kummerfeld, J., Bansal, M., Burkett, D., Klein, D. (2022). Mention Detection: Heuristics for the OntoNotes annotations. 15th Conference on Computational Natural Language Learning, Stroudsburg, Pennsylvania, United States: Association for Computational Linguistics (ACL).
Burdick, L., Kummerfeld, J., Mihalcea, R. (2022). Using Paraphrases to Study Properties of Contextual Embeddings. 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, United States of America: Association for Computational Linguistics (ACL).

show 1 more

2021

Burdick, L., Kummerfeld, J., Mihalcea, R. (2021). Analyzing the Surprising Variability in Word Embedding Stability Across Languages. 2021 Conference on Empirical Methods in Natural Language Processing, Dominican Republic: Empirical Methods in Natural Language Processing.
Lahnala, A., Kambhatla, G., Peng, J., Whitehead, M., Minnehan, G., Guldan, E., Kummerfeld, J., Camcı, A., Mihalcea, R. (2021). Chord Embeddings: Analyzing What They Capture and Their Role for Next Chord Prediction and Artist Attribute Prediction. 10th International Conference on Artificial Intelligence in Music, Sound, Art and Design, Online: Springer. [More Information]
Huffaker, J., Kummerfeld, J., Lasecki, W., Ackerman, M. (2021). Crowdsourced Detection of Emotionally Manipulative Language. 2020 ACM CHI Conference on Human Factors in Computing Systems (CHI EA 2020), Honolulu: Association for Computing Machinery (ACM). [More Information]
Kummerfeld, J., Klein, D. (2021). Error-Driven Analysis of Challenges in Coreference Resolution. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Washington: Association for Computational Linguistics (ACL).
Lahnala, A., Zhao, Y., Welch, C., Kummerfeld, J., An, L., Resnicow, K., Mihalcea, R., Perez-Rosas, V. (2021). Exploring Self-Identified Counseling Expertise in Online Support Forums. Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, United States: Association for Computational Linguistics (ACL). [More Information]
Rajendran, J., Kummerfeld, J., Singh, S. (2021). Learning to Learn End-to-End Goal-Oriented Dialog From Related Dialog Tasks. 3rd Workshop on Natural Language Processing for Conversational AI, NLP4ConvAI 2021, United States: Association for Computational Linguistics (ACL).
Lee, A., Kummerfeld, J., An, L., Mihalcea, R. (2021). Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Health. 2021 Findings of the Association for Computational Linguistics, Findings of ACL: EMNLP 2021, United States: Association for Computational Linguistics (ACL).
Larson, S., Mahendran, A., Lee, A., Kummerfeld, J., Hill, P., Laurenzano, M., Hauswald, J., Tang, L., Mars, J. (2021). Outlier Detection for Improved Data Quality and Diversity in Dialog Systems. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minnesota: Association for Computational Linguistics (ACL). [More Information]
Kim, S., Galley, M., Gunasekara, C., Lee, S., Atkinson, A., Peng, B., Schulz, H., Gao, J., Li, J., Adada, M., et al (2021). Overview of the Eighth Dialog System Technology Challenge: DSTC8. IEEE/ACM Transactions on Audio Speech and Language Processing, 29, 2529-2540. [More Information]
Kummerfeld, J. (2021). Quantifying and Avoiding Unfair Qualification Labour in Crowdsourcing. Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL-IJCNLP 2021, Online: The Association for Computational Linguistics.
Burdick, L., Kummerfeld, J., Mihalcea, R. (2021). To Batch or Not to Batch? Comparing Batching and Curriculum Learning Strategies across Tasks and Datasets. Journal of Mathematics, 9(18).
Burdick, L., Kummerfeld, J., Mihalcea, R. (2021). To batch or not to batch? Comparing batching and curriculum learning strategies across tasks and datasets. Mathematics, 9(18). [More Information]

show 9 more

2020

Welch, C., Kummerfeld, J., Perez-Rosas, V., Mihalcea, R. (2020). Compositional Demographic Word Embeddings. 2020 Conference on Empirical Methods in Natural Language Processing, United States: Association for Computational Linguistics (ACL).
Welch, C., Kummerfeld, J., Perez-Rosas, V., Mihalcea, R. (2020). Exploring the Value of Personalized Word Embeddings. Proceedings of the 28th International Conference on Computational Linguistics, United States: International Committee on Computational Linguistics. [More Information]
Welch, C., Mihalcea, R., Kummerfeld, J. (2020). Improving Low Compute Language Modeling with In-Domain Embedding Initialisation. 2020 Conference on Empirical Methods in Natural Language Processing, United States: Association for Computational Linguistics (ACL).
Larson, S., Cheung, A., Mahendran, A., Leach, K., Kummerfeld, J. (2020). Inconsistencies in Crowdsourced Slot-Filling Annotations: A Typology and Identification Methods. Proceedings of the 28th International Conference on Computational Linguistics, United States: International Committee on Computational Linguistics. [More Information]
Larson, S., Zheng, A., Mahendran, A., Tekriwal, R., Cheung, A., Guldan, E., Leach, K., Kummerfeld, J. (2020). Iterative Feature Mining for Constraint-Based Data Collection to Increase Data Diversity and Model Robustness. 2020 Conference on Empirical Methods in Natural Language Processing, United States: Association for Computational Linguistics (ACL).
D'Haro, L., Yoshino, K., Hori, C., Marks, T., Polymenakos, L., Kummerfeld, J., Galley, M., Gao, X. (2020). Overview of the seventh Dialog System Technology Challenge: DSTC7. Computer Speech and Language, 62, 101068-1-101068-21. [More Information]

show 3 more

2019

Kummerfeld, J., Gouravajhala, S., Peper, J., Athreya, V., Gunasekara, C., Ganhotra, J., Patel, S., Polymenakos, L., Lasecki, W. (2019). A Large-Scale Corpus for Conversation Disentanglement. 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019), Stroudsburg: Association for Computational Linguistics (ACL). [More Information]
Larson, S., Mahendran, A., Peper, J., Clarke, C., Lee, A., Hill, P., Kummerfeld, J., Leach, K., Laurenzano, M., Tang, L., et al (2019). An Evaluation for Intent Classification and Out-of-Scope Prediction. 2019 Conference on Empirical Methods in Natural Language Processing, Hong Kong: Association for Computational Linguistics (ACL). [More Information]
Gunasekara, C., Kummerfeld, J., Polymenakos, L., Lasecki, W. (2019). DSTC7 Task 1: Noetic End-to-End Response Selection. Dialog System Technology Challenges at AAAI 2019, (pp. 60-67). Florence, Italy: Association for Computational Linguistics (ACL). [More Information]
Welch, C., Perez-Rosas, V., Kummerfeld, J., Mihalcea, R. (2019). Learning from Personal Longitudinal Dialog Data. IEEE Intelligent Systems, 34(4), 16-23. [More Information]
Welch, C., Perez-Rosas, V., Kummerfeld, J., Mihalcea, R. (2019). Look Who's Talking: Inferring Speaker Attributes from Personal Longitudinal Dialog. 20th International Conference on Computational Linguistics and Intelligent Text Processing, La Rochelle, France: Springer.
Paquette, P., Lu, Y., Bocco, S., Smith, M., Ortiz-Gagne, S., Kummerfeld, J., Singh, S., Pineau, J., Courville, A. (2019). No press diplomacy: Modeling multi-agent gameplay. Advances in Neural Information Processing Systems 32: 33rd Annual Conference on Neural Information Processing Systems 2019, San Diego, USA: Neural Information Processing Systems (NIPS).
Kummerfeld, J. (2019). SLATE: A Super-Lightweight Annotation Tool for Experts. 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019), Stroudsburg: Association for Computational Linguistics (ACL). [More Information]

show 4 more

2018

Kang, Y., Zhang, Y., Kummerfeld, J., Tang, L., Mars, J. (2018). Data Collection for a Production Dialogue System: A Startup Perspective. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3, New Orleans - Louisiana: Association for Computational Linguistics (ACL). [More Information]
Jiang, Y., Finegan-Dollak, C., Kummerfeld, J., Lasecki, W. (2018). Effective crowdsourcing for a new type of summarization task. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3, New Orleans - Louisiana: Association for Computational Linguistics (ACL).
Wendlandt, L., Kummerfeld, J., Mihalcea, R. (2018). Factors Influencing the Surprising Instability of Word Embeddings. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3, New Orleans - Louisiana: Association for Computational Linguistics (ACL).
Finegan-Dollak, C., Kummerfeld, J., Zhang, L., Ramanathan, K., Sadasivam, S., Zhang, R., Radev, D. (2018). Improving Text-to-SQL Evaluation Methodology. 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018), Stroudsburg: Association for Computational Linguistics (ACL). [More Information]
Welch, C., Kummerfeld, J., Feng, S., Mihalcea, R. (2018). World Knowledge for Abstract Meaning Representation Parsing. 11th International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki: European Language Resources Association (ELRA).

show 2 more

2017

Durrett, G., Kummerfeld, J., Berg-Kirkpatrick, T., Portnoff, R., Afroz, S., McCoy, D., Levchenko, K., Paxson, V. (2017). Identifying Products in Online Cybercrime Marketplaces: A Dataset for Fine-grained Domain Adaptation. Conference on Empirical Methods in Natural Language Processing, United States: Association for Computational Linguistics (ACL). [More Information]
Kummerfeld, J., Klein, D. (2017). Parsing with Traces: An O(n4) Algorithm and a Structural Representation. ACL Anthology, 5, 441-454. [More Information]
Portnoff, R., Kummerfeld, J., Afroz, S., Berg-Kirkpatrick, T., Durrett, G., McCoy, D., Levchenko, K., Paxson, V. (2017). Tools for Automated Analysis of Cybercriminal Markets. 26th International World Wide Web Conference (WWW 2017), Perth, WA: Association for Computing Machinery (ACM). [More Information]
Jiang, Y., Kummerfeld, J., Lasecki, W. (2017). Understanding Task Design Trade-offs in Crowdsourced Paraphrase Collection. 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017), Stroudsburg, PA: Association for Computational Linguistics (ACL). [More Information]

show 1 more

2015

Kummerfeld, J., Berg-Kirkpatrick, T., Klein, D. (2015). An Empirical Analysis of Optimization for Max-Margin NLP. 2015 Conference on Empirical Methods in Natural Language Processing, United States of America: Association for Computational Linguistics (ACL).

2013

Kummerfeld, J., Tse, D., Curran, J., Klein, D. (2013). An Empirical Examination of Challenges in Chinese Parsing. 51st Annual Meeting of the Association for Computational Linguistics (ACL 2013), Stroudsburg, PA USA: Association for Computational Linguistics (ACL).
Moss, V., McClure-Griffiths, N., Murphy, T., Pisano, D., Kummerfeld, J., Curran, J. (2013). High-Velocity Clouds in the Galactic All Sky Survey. I. Catalog. The Astrophysical Journal Supplement Series, 209(1), 1-18. [More Information]

2012

Kummerfeld, J., Hall, D., Curran, J., Klein, D. (2012). Parser Showdown at the Wall Street Corral: An Empirical Investigation of Error Types in Parser Output. Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (emnlp-conll 2012), Stroudsburg, PA: Association for Computational Linguistics (ACL).
Kummerfeld, J., Klein, D., Curran, J. (2012). Robust Conversion of CCG Derivations to Phrase Structure Trees. The 50th Annual Meeting of the Association for Computational Linguistics (ACL 2012), Stroudsburg: Association for Computational Linguistics (ACL).

2010

Kummerfeld, J., Roesner, J., Dawborn, T., Haggerty, J., Curran, J., Clark, S. (2010). Faster Parsing by Supertagger Adaptation. 48th Annual Meeting of the Association for Computational Linguistics (ACL 2010), Sweden: Association for Computational Linguistics (ACL).
Honnibal, M., Kummerfeld, J., Curran, J. (2010). Morphological analysis can improve a CCG parser for English. 23rd International Conference on Computational Linguistics, Beijing, China: Press of Tsinghua University.
Candelier, R., Widmer-Cooper, A., Kummerfeld, J., Dauchot, O., Biroli, G., Harrowell, P., Reichman, D. (2010). Spatiotemporal hierarchy of relaxation events, dynamical heterogeneities, and structural reorganization in a supercooled liquid. Physical Review Letters, 105(13), 135702-1-135702-4. [More Information]

2009

Kummerfeld, J., Curran, J., Roesner, J. (2009). Faster parsing and supertagging model extimation. Australasian Language Technology Association Workshop (ALTA 2009), Australia: Australasian Language Technology Association.

2008

Kummerfeld, J., Curran, J. (2008). Classification of Verb-Particle Constructions with the Google Web1T Corpus. Australasian Language Technology Association Workshop 2008 (ALTA), Australia: Australasian Language Technology Association.
Kummerfeld, J., Hudson, T., Harrowell, P. (2008). The Densest Packing of AB Binary Hard-Sphere Homogeneous Compounds across all Size Ratios. The Journal of Physical Chemistry B, 112(35), 10773-10776. [More Information]

Selected Grants

2024

Complementing Human Intelligence to Recognize Opponent Narratives (CHIRON), Kummerfeld J, Defense Advanced Research Projects Agency (USA)/Research Support

2023

Making Sense of Language Model Outputs for End User Tasks, Kummerfeld J, Amazon Science/Amazon Research Awards Program
Efficient Annotation through New Task Decomposition and Recombination Methods, Kummerfeld J, Google Asia Pacific Pte. Ltd/Research Support

2022

Generating Plots with Dialogue Based Executable Semantic Parsing, Kummerfeld J, Australian Research Council (ARC)/Discovery Early Career Researcher Award (DECRA)
Language Modeling for Dialogue Systems, Kummerfeld J, Google Asia Pacific Pte. Ltd/Research Support

2021

ALLAN Agents Learning Lying And Negotiation, Boyd-Graber J, Kummerfeld J, May J, Stewart B, Narasimhan K, Defense Advanced Research Projects Agency (USA)/Research Support