Article
Exploratory Data Analysis and Crime Prediction for Smart Cities
IDEAS '19: Proceedings of the 23rd International Database Applications & Engineering Symposium
(2019)
Abstract
Crime has been prevalent in our society for a very long time and it continues to be so even today. Currently, many cities have released crime-related data as part of an open data initiative. Using this as input, we can apply analytics to be able to predict and hopefully prevent crime in the future. In this work, we applied big data analytics to the San Francisco crime dataset, as collected by the San Francisco Police Department and available through the Open Data initiative. The main focus is to perform an in-depth analysis of the major types of crimes that occurred in the city, observe the trend over the years, and determine how various attributes contribute to specific crimes. Furthermore, we leverage the results of the exploratory data analysis to inform the data preprocessing process, prior to training various machine learning models for crime type prediction. More specifically, the model predicts the type of crime that will occur in each district of the city. We observe that the provided dataset is highly imbalanced, thus metrics used in previous research focus mainly on the majority class, disregarding the performance of the classifiers in minority classes, and propose a methodology to improve this issue. The proposed model finds applications in resource allocation of law enforcement in a Smart City.
Disciplines
Publication Date
June, 2019
DOI
10.1145/3331076.3331114
Publisher Statement
SJSU users: Use the following link to login and access this article via SJSU databases.
Citation Information
Isha Pradhan, Katerina Potika, Magdalini Eirinaki and Petros Potikas. "Exploratory Data Analysis and Crime Prediction for Smart Cities" IDEAS '19: Proceedings of the 23rd International Database Applications & Engineering Symposium (2019) p. 1 - 9 Available at: http://works.bepress.com/aikaterini-potika/35/