2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA)(

In order to improve the efficiency and adaptability of classical random forest algorithm in large data environment, an improved random forest algorithm based on Spark is proposed. Firstly, an improved random forest algorithm (FRF) based on the Fayyad boundary point principle is proposed to deal with the shortcomings of classical random forest algorithm in the process of discretization of continuou... View full abstract»

High population growth, urbanization, and global climate change drive up the frequency of disasters, causing grave losses of people's lives and property worldwide. Additionally, globalization, technological development, and the changing roles of individuals in society will require entirely new approaches, tools, and capabilities to help inform decision making under uncertain conditions. However, t... View full abstract»

The new data environment composed by big data and open data has descripted urban physical and social space in a more detailed way. Currently, numerous quantitative urban studies have been conducted under new data environment. However, most studies concentrated on status quo evaluation and problem identification of urban system, and few of them have a perspective into future-oriented urban planning... View full abstract»

Data-driven agronomy is becoming popular by reducing the climate uncertainty in the era of agriculture big data. In this paper, many data mining approaches were used to extract embedded knowledge from climate variability and explore the relationship between NDVI data and maize yield. The results show that the Oct NDVI is important for Liaoning, while the Aug NDVI is important for Heilongjiang and ... View full abstract»

Using Baidu thermal diagram big data, analyzed the spatial and temporal behavior of Wuyi square, by applying spatial clustering, nuclear density analysis, spatial superposition and other spatial quantitative analysis method, verify and explain this time and space dynamic changes of internal factors. According to the analysis, under the support of Baidu thermal diagram big data, the dynamic changes... View full abstract»

Researchers often discuss marketing strategies against the backdrop of big data, or use big data in tourism marketing. Limited is known about how a destination should use social media for tourism marketing at big data age. The paper is trying to do a tentative exploration for it by taking the WeChat tourism marketing of Dehong Dai and Jingpo autonomous prefecture for the national day golden week i... View full abstract»

To analysis the taxi trajectory data, an unified intelligent transportation platform which is based on Hadoop and massively parallel processing technology is constructed. In the intelligent transportation platform, the design model, function modules, technical scheme and SGD algorithm are proposed. Combining with the operation of the vehicle data, the platform realizes data analysis for vehicle tr... View full abstract»

Taxi serves as a main transportation means for urban residents. The driving behavior recorded by Taxi GPS data can be a mirror to urban life. Therefore, this study adopts taxi GPS data to extract active area of the city and examine the weekday and weekend discrepancy. Moreover, the point of interests (POI) is combined to reveal the characteristics of the city. The method proposed in this study can... View full abstract»

In this article, an efficient and scalable distributed web crawler system based on Hadoop will be design and implement. In the paper, firstly the application of cloud computing in reptile field is introduced briefly, and then according to the current status of the crawler system, the specific use of Hadoop distributed and cloud computing features detailed design of a highly scalable crawler system... View full abstract»

Information constructions at colleges have transferred from digitalized campus to intelligence campus. Data switching center makes converting, cleansing, monitoring, comparison and other process to data of each business system, which provides an important support to intelligence campus. View full abstract»

Twenty-first century as an important symbol of the era of the knowledge economy and big data, Internet and networking have a rapid development and have become indispensable data sources in people's lives. Besides, because of its convenience and quickness, these are increasingly applied in more and more aspects. Among them, POI as a true representative of the geographical entity on the network map ... View full abstract»

Output power determination of wind generators is always associated with some uncertainties due to wind speed and other weather parameters alteration, and precise short-term predictions are essential for their efficient operation. This can efficiently support transmission and distribution system operators and schedulers to improve the power network control and management. In this paper, we propose ... View full abstract»

Power generation from wind generators is always associated with some intermittency due to wind speed and other weather parameters variation, and accurate short-term forecasts are essential for their efficient and effective operation. This can well support transmission and distribution system operators and schedulers to enhance the power network control and management in the smart grid context. Thi... View full abstract»

High-precision spectral analysis techniques are the important means to carry out research of rotor system stability. It can be achieved feature extraction parameters about rotor system steady-state and spectrum of vibration signals during speeding-change process. For a big calculation error problem existed in commercial software come with spectral analysis in the status, It is proposed that the sp... View full abstract»

Traditional power flow algorithm such as the trend for front-and-spoke networks and backward substitution method and a cyclic structure NR method cannot fully reflect the uncertainties affecting the system, and a lot of new energy sources access to change the original properties of the grid, so that a single flow algorithm has significant limitations, the study calculated adapt to the trend of lar... View full abstract»

In order to study coastal intensive large-scale wind farm output characteristics and interrelatedness, take large-scale wind farm in coastal Jiangsu as an example, based on the measured wind power output data in EMS systems correlation between wind farms and the active output probability distributions, the monthly maximum output were analyzed. Studied the active output fluctuations of wind farms a... View full abstract»

Research on evaluation for overload probability, probability-limit and static safety of voltage based on stochastic trend, can be used to discover vulnerabilities in the power grid. Wind power output, load changes, forced outages and generator fault lines and other uncertainties were considered. Random disturbances of large-scale new energy generation accessing the grid concerned, linear Monte Car... View full abstract»

This paper studies the structure features of the collected power consumers' power consumption data, in which the 96 measured data points indicating a single user's power consumption curve of a day. The 96 measured data points are taken as 96 variables for analysis. The dimensionality of original data is reduced by principal component analysis (PCA), and then the K-means algorithm is employed to cl... View full abstract»