Skip to main content

Reducing the Data Cost of Machine Learning with AI: A Case Study

  • Conference paper
  • First Online:
Advances in Artificial Intelligence and Applied Cognitive Computing

Abstract

The past several years have seen a strong push toward using Deep Learning systems–Neural Networks with multiple hidden layers. Deep Learning is now used in many machine learning applications and provides leading performance on numerous benchmark tasks. However, this increase in performance requires very large datasets for training. From a practitioner prospective, the model that performs best in benchmark tasks may be too data intensive to be adapted to practical application. We describe a behavior recognition problem that was solved using a sequence-based Deep Learning system and then reimplemented using a more knowledge-driven sequence matching approach due to data constraints. We contrast the two approaches and the data required to achieve sufficient performance and flexibility.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. D. Silver, J. Schrittwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton, et al., Mastering the game of go without human knowledge. Nature 550(7676), 354–359 (2017)

    Article  Google Scholar 

  2. A. Ng, Machine learning yearning: Technical strategy for ai engineers in the era of deep learning (2019). Retrieved online at https://www.mlyearning.org

  3. G.L. Zacharias, J.E. Macmillan, S.B. Van Hemel, Behavioral Modeling and Simulation: From Individuals to Societies (National Academies Press, Washington, 2008)

    Google Scholar 

  4. R.W. Pew, A.S. Mavor, Modeling Human and Organizational Behavior-Application to Military Simulations (National Academies Press, Washington, 1998)

    Google Scholar 

  5. K. Erol, J. Hendler, D.S. Nau, HTN planning: Complexity and expressivity, in AAAI, vol. 94 (1994), pp. 1123–1128.

    Google Scholar 

  6. V. Hung, J. Haley, R. Bridgman, N. Timpko, R. Wray, Synthesizing machine-learning datasets from parameterizable agents using constrained combinatorial search, in International Conference on Social Computing, Behavioral-Cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation (Springer, Berlin, 2019,) pp. 60–69

    Google Scholar 

  7. J. Haley, V. Hung, R. Bridgman, N. Timpko, R. Wray, Low level entity state sequence mapping to high level behavior via a DeepLSTM model, in Proceedings on the International Conference on Artificial Intelligence (ICAI). The Steering Committee of The World Congress in Computer Science, Computer … (2018), pp. 131–136

    Google Scholar 

  8. R.E. Wray, J. Haley, R. Bridgman, A. Brehob, Comparison of complex behavior via event sequences, in 2019 International Conference on Computational Science and Computational Intelligence (CSCI) (IEEE, Piscataway, 2019), pp. 266–271

    Google Scholar 

  9. M.S. Waterman, General methods of sequence comparison. Bull. Math. Biol. 46(4), 473–500 (1984)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

The authors thank Robert “Norb” Timpko, Victor Hung, and Chris Ballinger for contributions to concepts and implementations reported here. We also thank Dr. Heather Priest and Ms. Jennifer Pagan for contributions to problem definitions and solution context that informed our approach. Opinions expressed here are not necessarily those of the Department of Defense or the sponsor of this effort, the Naval Air Warfare Center Training Systems Division (NAWCTSD). This work was funded under contract no. N68335-17-C-0574.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Joshua Haley .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Haley, J., Wray, R., Bridgman, R., Brehob, A. (2021). Reducing the Data Cost of Machine Learning with AI: A Case Study. In: Arabnia, H.R., Ferens, K., de la Fuente, D., Kozerenko, E.B., Olivas Varela, J.A., Tinetti, F.G. (eds) Advances in Artificial Intelligence and Applied Cognitive Computing. Transactions on Computational Science and Computational Intelligence. Springer, Cham. https://doi.org/10.1007/978-3-030-70296-0_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-70296-0_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-70295-3

  • Online ISBN: 978-3-030-70296-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics