Using multi-criteria analysis for smart city assessment


  • Daiane Maria De Genaro Chiroli Federal University of Technology – Paraná
  • Érica A. B. Solek Federal Technological University of Paraná – Ponta Grossa
  • Rosana S. Oliveira Federal Technological University of Paraná – Ponta Grossa
  • Bertiene M. L. Barboza Federal Technological University of Paraná – Ponta Grossa
  • Rodolfo P. de Campos Federal Technological University of Paraná – Ponta Grossa
  • João L. Kovaleski Federal Technological University of Paraná – Ponta Grossa
  • Sérgio M. Tebecherani Federal Technological University of Paraná – Ponta Grossa
  • Flavio Trojan Federal Technological University of Paraná – Ponta Grossa


Smart Cities Ranking, Multi-criteria analysis, Criteria Weights


Urban centers have been under a new concept of city. Smart Cities are, in a nutshell, organized communities that feature high communication technology and conscious investments in sustainability, providing dynamic and safe environments. This paper presents a methodology to assess and rank Smart Cities based on a multi-criteria decision-making process. Methodologies that do not consider a pondered approach and filter for specific goals are commonly found in the literature, once there is a great number of criteria involved in these analyses. This work proposes filtering the criteria, considering each specific evaluation and its objectives. Our methodology is based on a multi-criteria analysis and uses AHP (Analytic Hierarchy Process) to support the process of weights definition and MACBAC (Multi-Attributive Border Approximation Area Comparison) in an application with compensatory characteristics. Through this study, it is possible to conduct the assessment of Smart Cities according to its multiple contexts, viz. its location, decision-makers and the objectives of the analysis. All in all, this research presents novelty related to the organization of the evaluation in accord to the expected resolution and a pondered approach with reduced number of criteria, making the analysis very straightforward.


Albino, V., Berardi, U., Dangelico, R. M. (2015). Smart Cities: Definitions, Dimensions, Performance, and Initiatives. Journal Of Urban Technology, 22(1), 3–21.

Álvarez-García, J., Del Río-Rama, M. de la C., Vázquez-Huerta, G., Rueda-Armengot, C. (2017). Sustainable Smart Cities - theory. Sustainable Smart Cities, (September), 1–14.

Aragão, F. V., P. F. d. O. Gomes, D. d. G. Chiroli, F. C. Zola, E. d. F. Rocha Loures, E. A. P. Santos, and J. C. Colmenero. (2021). Projects Aimed at Smart Cities: A Hybrid MCDA Evaluation Approach. Technology Analysis & Strategic Management, 33, 1–13.

Aragão, F. V., Zola, F. C., Marinho, L. H. N., de Genaro Chiroli, D. M., Junior, A. B., & Colmenero, J. C. (2020). Choice of unmanned aerial vehicles for identification of mosquito breeding sites. Geospatial Health, 15(1).

Barrionuevo, J. M., Berrone, P., & Ricart Costa, J. E. (2012). Smart Cities, Sustainable Progress: Opportunities for Urban Development. IESE Insight, 14, 50–57.

Bennett, D., Pérez-Bustamante, D. & Medrano, M. (2017). Challenges for Smart Cities in the UK. Sustainable Smart Cities. Innovation, Technology, and Knowledge Management.

Bhada, P., Dan.H. (2009). The Global City Indicators Program: A More Credible Voice for Cities. Directions in Urban Development. Washington, DC: World Bank.

Bibri, S. E. (2018). A foundational framework for smart sustainable city development: Theoretical, disciplinary, and discursive dimensions and their synergies. Sustainable Cities and Society, 38, 758–794.

Bifulco F., Tregua, M., Amitrano, C.C., D’Auria, A. (2015). ICT and sustainability in smart cities management, International Journal of Public Sector Management, 29, (2), 132–147.

Carvalho, F. S. de, França Bail, R. de, Pagani, R. N., Pilatti, L. A., Kovaleski, J. L., & de Genaro Chiroli, D. M. Urban Mobility in Smart Cities: a case study in the city of Curitiba. International Journal of Development Research, 11(06), 48151–48157.

Capdevila, I., & Zarlenga, M. I. (2015). Smart city or smart citizens? The Barcelona case. Journal of Strategy and Management, 8(3), 266–282.

Chong, M., Habib, A., Evangelopoulos, N., & Park, H. W. (2018). Dynamic capabilities of a smart city: An innovative approach to discovering urban problems and solutions. Government Information Quarterly.

Gascó-Hernandez, M. (2018). Building a Smart City: Lessons from Barcelona. Communications of the ACM, 61 (4), 50–57.

Giffinger, R., C., et al. (2007). Smart cities: Ranking of European medium-sized cities.

Giovannella, C., Iosue, A., Moggio, F., Rinaldi, E., & Schiattarella, M. (2013). User Experience of Kinect Based Applications for Smart City Scenarios Integrating Tourism and Learning. IEEE 13th International Conference on Advanced Learning Technologies.

Gomes, L. F. A. M., et al. (2002). Tomada de Decisão Gerencial: enfoque multicritério, São Paulo, Atlas.

Harker, P. T., Vargas, L. G. (1987). The theory of ratio scale estimation: Saaty’s analytic hierarchy process. Management Science, 33(11), 1383–1403.

Hoang, G., Dupont, L., & Camargo, M. (2019). Application of Decision-Making Methods in Smart City Projects: A Systematic Literature Review. Smart Cities, 2(3), 433–452.

Hollands, R. G. (2008). Will the real smart city please stand up? Intelligent, progressive or entrepreneurial?. City, 12(3), 303–320.

Huovila, A., Bosch, P., & Airaksinen, M. (2019). Comparative analysis of standardized indicators for Smart sustainable cities: What indicators and standards to use and when?. Cities, 89, 141–153.

IPARDES, Parana Institute of Economic and Social Development. (2019). Statistical Book-let: Municipalities of the state of Parana.

ISO - International Organization for Standardization. ISO 37120 (2014). Sustainable development of communities: indicators for city services and quality of life. Genebra.

ISO - International Organization for Standardization. ISO 37120 (2018). ISO 37120: Sustain-able cities and communities — Indicators for city services and quality of life. Genebra.

Klopp, J. M., & Petretta, D. L. (2017). The urban sustainable development goal: Indicators, complexity and the politics of measuring cities. Cities, 63, 92–97.

Komninos, N. (2009). Intelligent cities: towards interactive and global innovation environments. International Journal of Innovation and Regional Development, 1(4), 337.

Lazaroiu, G. C., & Roscia, M. (2012). Definition methodology for the smart cities model. Energy, 47(1), 326–332.

Lombardi, P., Giordano, S., Farouh, H., & Yousef, W. (2012). Modelling the smart city performance. Innovation, 25(2), 137–149.

Marsal-Llacuna, M. L., Colomer-Llinàs, J., & Meléndez-Frigola, J. (2015). Lessons in urban monitoring taken from sustainable and livable cities to better address the Smart Cities initiative. Technological Forecasting and Social Change, 90(PB), 611–622.

Mattoni, B., Nardecchia, F., & Bisegna, F. (2019). Towards the development of a smart district: The application of an holistic planning approach. Sustainable Cities and Society, 48, 101570.

MCTI - Ministério da Ciência, Tecnologia e Inovações. (2020). CTI/MCTI prepara diagnóstico do estágio dos municípios brasileiros na transição para Cidades inteligentes.

Mello, V. G., Kovaleski, J. L., Zola, F. C., Lima Junior, F. R., Aragão, F. V., Chiroli, D. M. G. (2022) Proposal of a Fuzzy-QFD model for startup selection. Technology Analysis & Strategic Management,

Ministério do Desenvolvimento Regional (2020). Carta brasileira para cidades inteligentes. 2020.

Moura, E. H., Rocha e Cruz, T. B., De Genaro Chiroli, D. M. (2020). A framework proposal to integrate humanitarian logistics practices, disaster management and disaster mutual assistance: A Brazilian case. Safety Science, 132, (December), 104965.

MPPR, Paraná Public Ministry (2018). MPPR website.

Nam, T., & Pardo, T. A. (2014). The changing face of a city government: A case study of Philly311. Government Information Quarterly, 31(suppl.1).

Pamucar, D., Cirovic, G. (2016). The selection of transport and handling resources in logistics centers using Multi-Attributive Border Approximation area Comparison (MABAC). Expert Systems with Applications, 42, 3016–3028.

Pereira, G. V., Bernardes, M. B., Bernardini, F., Cappelli, C., & Gomyde, A. (2017). Building a Reference Model and an Evaluation Method for cities of the Brazilian Network of Smart and Human Cities. Proceedings of the 18th Annual International Conference on Digital Government Research - Dg. 17.

Piekas, A. A. S., Bernardy, R. J., Sehnem, S., & Fabris, J. (2018). Legal aspects and perceptions about strategies for smart and creative cities: a study of the city of Chapecó (SC). Urbe. Revista Brasileira de Gestão Urbana, 10(suppl. 1), 197–211.

Pomerol, J.-C., and S. Barba-Romero. (2012). Multicriterion Decision in Management: Principles and Practice, 25. Boston, MA: Springer Science & Business Media.

Rozhenkova, V., Allmang, S., Ly, S., Franken, D., & Heymann, J. (2019). The role of comparative city policy data in assessing progress toward the urban SDG targets. Cities, 95(489), 102357.

Saaty, T. L., Vargas, L. G. (1984). The legitimacy of rank reversal. OMEGA, 12(5), 513–516.

Shimizu, T (2006). Decision in Organizations. 2nd edition. São Paulo, Atlas.

Silva, A. (2017). Smart Cities: Proposition of a Multicriteria Analysis Model to verify the Performance of Brazilian Cities. Universidade de Brasília, Brasília.

Soares, A.M., Kovaleski, J.L., Gaia, S., Chiroli, D.G. (2020). Building Sustainable Development through Technology Transfer Offices: An Approach Based on Levels of Maturity. Sustainability 12(5), 1795.

Stanković, J., Džunić, M., Džunić, Ž., & Marinković, S. (2017). A multi-criteria evaluation of the European cities’ smart performance: Economic, social and environmental aspects. Zbornik radova Ekonomskog fakulteta u Rijeci: časopis za ekonomsku teoriju i praksu, 35(2), 519–550.

Store, R., & Kangas, J. (2001). Integrating spatial multi-criteria evaluation and expert knowledge for GIS-based habitat suitability modelling. Landscape and Urban Planning, 55(2), 79–93.

United Nations. (2015). Transforming our world: The 2030 agenda for sustainable development. General Assembley 70 session.

Van Zoonen, L. (2016). Privacy concerns in smart cities. Government Information Quarterly, 33(3), 472–480.

Vargas, L. G. (1990). Overview of the analytic hierarchy process and its applications. European Journal of Operational Research, 48, 2–8.

Vincke, P. (1992). Multicriteria Decision-aid. England: John Wiley & Sons.

Weingart, L. R., Thompson, L. L., Bazerman, M. H., & Carroll, J. S. (2006). ICT and sustainability in smart cities management. International Journal of Conflict Management, 1(1), 7–31.

Weiss, M. C., Tealde, E., Weiss, M. C., Thesis, M., Studies, G., Semester, S., … Berg, M. (2013). Smart cities as a new practice for managing urban services and infrastructure. Revista Brasileira de Gestão Urbana, 7(September), 310–324.

WWCD, World Council on City Open Data Portal (2017). WCCODP website.

Yigitcanlar, T., Kamruzzaman, M., Foth, M., Sabatini, J., da Costa, E., & Ioppolo, G. (2018). Can cities become smart without being sustainable? A systematic review of the literature. Sustainable Cities and Society.

Zanella, A., Bui, N., Castellani, A., Vangelista, L., & Zorzi, M. (2014). Internet of Things for Smart Cities. IEEE Internet of Things Journal, 1(1), 22–32.

Zhu, S., Li, D., & Feng, H. (2019). Is smart city resilient? Evidence from China. Sustainable Cities and Society, 101636.

Zola, F. C., J. C. Colmenero, F. V. Aragão, T. Rodrigues, and A. B. Junior. 2020. Multicriterial Model for Selecting a Charcoal Kiln. Energy, 190. 116–377.