Features
May 21, 2024

Solving the Problem of Market Failure Associated with Data Scraping: The Behavior Regulatory Pattern

Publication: Journal of Legal Affairs and Dispute Resolution in Engineering and Construction
Volume 16, Issue 3

Abstract

In the digital age, the business environment is experiencing unprecedented transformations caused by big data technologies that provide the resources for the survival and prosperity of business platforms as well as unique competitive advantages for long-term growth. As the data becomes more available, the importance of its effective protection against third-party scraping increases. However, the regulatory pattern of data protection remains a subject of debate, leaving the boundaries of data identification blurred. The study aims to design a methodological approach to analyzing the regulation of the market participants and their behavior under unfair competition to solve the problem of market failure associated with data scraping. Based on a survey conducted among managers of Chinese, American, German, and Russian business platforms, a behavior regulation model in data scraping has been developed. The key factors influencing the clarity of data identification boundaries were highlighted. An integral efficiency indicator was also introduced. The specific features of data scraping and methods of protection against it in the US, China, Germany, and Russia were revealed. Moreover, a correlation between the effectiveness of internal, and legal data protection and the net profit dynamics of business platforms in the studied countries has been found. The study has proved that the platform data collection boundaries can be accurately identified if all data collection factors are detailed.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

Data will be available upon request.

References

List of Statutes

Collection of Legislations of Russian Federation. 2002. Code of the Russian Federation on Administrative Offenses, Federal Law No. 195 (as amended on April 16, 2022). No. 1 (part I). Art.1. Collection of legislations of Russian Federation.
Collection of Legislations of Russian Federation. 2006a. Code of the Russian Federation on Administrative Offenses, Federal Law of July 27, 2006 No. 152 “On Personal Data”. No. 31 (part I). Art. 3451. Collection of legislations of Russian Federation.
Collection of Legislations of Russian Federation. 2006b. Code of the Russian Federation on Administrative Offenses, Federal Law of July 27, 2006 No. 149 “On Information, Information Technologies and Protection of Information” (as amended and supplemented). No. 31 (part I). Art. 3448. Collection of legislations of Russian Federation.
Constitution. 1993. The Constitution of the Russian Federation. Article 29, paragraph 4. Accessed June 30, 2023. http://www.constitution.ru/10003000/10003000-4.htm.

Works Cited

Almeida, D., K. Shmarko, and E. Lomas. 2022. “The ethics of facial recognition technologies, surveillance, and accountability in an age of artificial intelligence: A comparative analysis of US, EU, and UK regulatory frameworks.” AI Ethics 2 (3): 377–387. https://doi.org/10.1007/s43681-021-00077-w.
Alqodsi, E. M., and D. Gura. 2023. “High tech and legal challenges: Artificial intelligence-caused damage regulation.” Cogent Soc. Sci. 9 (2): 2270751. https://doi.org/10.1080/23311886.2023.2270751.
Andrew, J., and M. Baker. 2021. “The general data protection regulation in the age of surveillance capitalism.” J. Bus. Ethics 168 (3): 565–578. https://doi.org/10.1007/s10551-019-04239-z.
Barney, J. 1991. “Firm resources and sustained competitive advantage.” J. Manage. 17 (1): 99–120. https://doi.org/10.1177/014920639101700108.
Benkler, Y. 2006. The wealth of networks: How social production transforms markets and freedom. New Haven, CT: Yale University Press.
Blue Yonder. 2023. “The world’s commerce runs.” Accessed June 30, 2023. https://blueyonder.com/.
Boyd, D., and K. Crawford. 2012. “Critical questions for big data: Provocations for a cultural, technological, and scholarly phenomenon.” Inf. Commun. Soc. 15 (5): 662–679. https://doi.org/10.1080/1369118X.2012.678878.
Cornell Law School. 2023a. “18 US Code § 1030—Fraud and related activity in connection with computers.” Accessed June 30, 2023. https://www.law.cornell.edu/uscode/text/18/1030.
Derclaye, E., and M. Husovec. 2022. Sui generis database protection 2.0: Judicial and legislative reforms (June 16, 2022). London: London School of Economics—Law School.
Dyatlova, E. V., and Y. R. Yanglicheva. 2022. “Parsing and law.” Bull. Econ. Law Soc. 2 (Feb): 49–52.
Egger, R., M. Kroner, and A. Stöckl. 2022. “Web scraping: Collecting and retrieving data from the web.” In Applied data science in tourism: Interdisciplinary approaches, methodologies, and applications, 67–82. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-88389-8_5.
ETHYCA. 2023. “Parsing the ADPPA draft from the privacy-as-code perspective.” Accessed June 30, 2023. https://ethyca.com/adppa-privacy-as-code.
Galli, F. 2022. “EU law on unfair commercial practices.” In Algorithmic marketing and EU law on unfair commercial practices, 157–179. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-031-13603-0_6.
Godinho de Matos, M., and I. Adjerid. 2022. “Consumer consent and firm targeting after GDPR: The case of a large telecom provider.” Manage. Sci. 68 (5): 3330–3378. https://doi.org/10.1287/mnsc.2021.4054.
Grishanova, N. 2020. “Parsing: From theory to judicial practice.” Accessed June 30, 2023. https://jurliga.ligazakon.net/ru/analitycs/194822_parsing-ot-teorii-do-sudebnoy-praktiki.
Gupta, G. 2022. “Does ‘big data’ provide a competitive advantage to firms: An antitrust analysis.” Asian J. Bus. Ethics 11 (2): 423–442. https://doi.org/10.1007/s13520-022-00159-w.
Husovec, M., and E. Derclaye. 2022. Why the sui generis database clause in the Data Act is counter-productive and how to improve it? London: London School of Economics—Law School. https://doi.org/10.2139/ssrn.4052390.
Jadalhaq, I. M., and E. M. Alqodsi. 2018. “Civil liability for misuse of online communication through websites: An analytical study of UAE law.” Inf. Commun. Technol. Law 27 (3): 284–303. https://doi.org/10.1080/13600834.2018.1517434.
Jia, J., G. Z. Jin, and L. Wagman. 2021. “The short-run effects of the general data protection regulation on technology venture Investment.” Mark. Sci. 40 (4): 661–684. https://doi.org/10.1287/mksc.2020.1271.
Justia. 1918. “International news service v. Associated Press, 248 US 215.” Accessed June 30, 2023. https://supreme.justia.com/cases/federal/us/248/215/.
Khan, N. F., N. Ikram, and S. Saleem. 2023. “Effects of socioeconomic and digital inequalities on cybersecurity in a developing country.” Secur. J. 1–31. https://doi.org/10.1057/s41284-023-00375-4.
Kutner, P. 2021. “Property torts and the restatements.” In Sjef‘-Sache’: Essays in Honour of Prof. Mr. Dr. JHM (Sjef) van Erp on the occasion of his retirement (Maastricht law series 18, 2021), 249–259. Maastricht, Netherlands: FdR Institute M-EPLI. https://doi.org/10.2139/ssrn.3897085.
Lee, J. A. 2021. “Unfair competition and antitrust law.” In Intellectual property law in China. Hong Kong: Chinese Univ. of Hong Kong Faculty of Law Research Paper.
Liu, W., and P. Chen. 2021. “Justification of the behavior regulatory pattern on data scraping.” Comput. Law Secur. Rev. 43 (Apr): 105578. https://doi.org/10.1016/j.clsr.2021.105578.
Mamontov, A. 2020. “Industries of the future. Investing in big data.” Accessed June 30, 2023. https://bcs-express.ru/novosti-i-analitika/industrii-budushchego-investitsii-v-bol-shie-dannye.
Markets and Markets. 2023. “Big data market.” Accessed June 30, 2023. https://www.marketsandmarkets.com/Market-Reports/big-data-market-1068.html.
Martin, K. D., and P. E. Murphy. 2017. “The role of data privacy in marketing.” J. Acad. Mark. Sci. 45 (2): 135–155. https://doi.org/10.1007/s11747-016-0495-4.
Ong, B. 2013. Historical, doctrinal, and policy-oriented perspectives on trade mark and unfair competition law (Germany). Hannover, Germany: Leibniz Univ. Hannover. https://doi.org/10.2139/ssrn.4268087.
Raguseo, E., and C. Vitari. 2018. “Investments in big data analytics and firm performance: An empirical investigation of direct and mediating effects.” Int. J. Prod. Res. 56 (15): 5206–5221. https://doi.org/10.1080/00207543.2018.1427900.
Ranjan, B., and B. K. Mishra. 2022. “Overview of big data and natural language processing: A powerful combination for research.” In Handbook of research for big data, 113–135. Waretown, NJ: Apple Academic Press. https://doi.org/10.1201/9781003144526-5.
Santesteban, C., and S. Longpre. 2020. “How big data confers market power to big tech: Leveraging the perspective of data science.” Antitrust Bull. 65 (3): 459–485. https://doi.org/10.1177/0003603X20934212.
Telitsyna, I., and D. Filonov. 2020. “A new era: How to develop business in digital reality?” Accessed June 30, 2023. https://www.forbes.ru/partnerskie-materialy-photogallery/402273-novaya-era-kak-biznesu-razvivatsya-v-cifrovoy-realnosti.
Vichugova, A. 2022. “How to prepare data for modeling: 5 data preparation steps.” Accessed June 30, 2023. https://www.bigdataschool.ru/blog/data-preparation-operations.html.
Voigt, P., and A. Von dem Bussche. 2017. The EU general data protection regulation (GDPR). A practical guide. 1st ed. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-57959-7.
Zhang, H., Y. Lou, and K. Cai. 2021. “Research on the dilemma and improvement of legal regulation for unfair competition related to corporate data in China.” Comput. Law Secur. Rev. 42 (Feb): 105582. https://doi.org/10.1016/j.clsr.2021.105582.

Information & Authors

Information

Published In

Go to Journal of Legal Affairs and Dispute Resolution in Engineering and Construction
Journal of Legal Affairs and Dispute Resolution in Engineering and Construction
Volume 16Issue 3August 2024

History

Received: Jul 3, 2023
Accepted: Jan 26, 2024
Published online: May 21, 2024
Published in print: Aug 1, 2024
Discussion open until: Oct 21, 2024

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

Pavel Babaritskii [email protected]
Faculty of Software Engineering and Computer Engineering, Mega-Faculty of Computer Technologies and Management, ITMO Univ., St. Petersburg 197227, Russia. Email: [email protected]; [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share