Academia.eduAcademia.edu

Random Search

description1,722 papers
group8 followers
lightbulbAbout this topic
Random search is an optimization technique that explores the solution space by randomly sampling candidate solutions. It is often used in scenarios where the search space is large or complex, allowing for the identification of satisfactory solutions without the need for gradient information or exhaustive search.
lightbulbAbout this topic
Random search is an optimization technique that explores the solution space by randomly sampling candidate solutions. It is often used in scenarios where the search space is large or complex, allowing for the identification of satisfactory solutions without the need for gradient information or exhaustive search.

Key research themes

1. How do random and stochastic local search methods balance exploration and exploitation to optimize search efficiency in complex spaces?

This theme examines strategies and theoretical foundations underpinning random search and stochastic local search algorithms, focusing on their ability to navigate high-dimensional, multi-modal, or uncertain environments. The research addresses how methods like iterated local search, novelty search, and stochastic quasi-gradient methods orchestrate exploration (diversification) and exploitation (intensification) to enhance optimization performance across combinatorial and continuous problem domains.

Key finding: Iterated Local Search (ILS) effectively improves embedded heuristics through iterative solution perturbation and local optimization, leading to significant quality gains without heavy problem-specific knowledge; the method... Read more
Key finding: Novelty Search asymptotically mimics a uniform random search in the behavior space due to constantly changing fitness landscapes, thereby focusing on exploration independent of explicit goals; this approach offers a novel... Read more
Key finding: The efficiency of a selected random search algorithm is analytically shown to be a linear function of step size and direction, indicating that careful calibration of these parameters can enhance search progress; this... Read more
by R Yap
Key finding: An integrated approach combining white-box visualization of search trajectories with black-box factorial design tuning significantly improves the design and parameter tuning of stochastic local search algorithms; this synergy... Read more
Key finding: The novel general drift theorem provides sharp tail bounds on hitting time distributions for randomized search heuristics with variable drift, revealing exponentially decreasing probabilities of large runtime deviations on... Read more

2. What are the theoretical and practical benefits of incorporating asymmetry and memory mechanisms in random and heuristic search algorithms?

This theme explores how asymmetry in search steps or biases, and memory-guided iteration improve the effectiveness of random and local search strategies. Investigations cover models that introduce directionality or state-retention mechanisms to enhance search speed and success, including asymmetric Levy flights and iterated algorithms that reuse or adapt prior search knowledge to escape local optima or improve convergence robustness.

Key finding: Asymmetry (skewness) in Lévy flight jumps decisively affects search efficiency, with directional biases outperforming symmetric Brownian motion or Lévy flights under varying target distances; the analytical model demonstrates... Read more
Key finding: By iteratively perturbing solutions and applying local search, ILS effectively reuses previous search information to explore promising solution neighborhoods, preventing redundant exploration and enabling escape from local... Read more
Key finding: Incremental search algorithms such as D* Lite that reuse previous search results often run slower than repeated A* in easy navigation problems due to initialization overhead and slower cell expansions, revealing that... Read more

3. How can random search and heuristic tuning methods enhance performance in machine learning model optimization and practical applications?

This theme investigates the application of random and heuristic search strategies, including random search for hyperparameter tuning and selection of heuristics for heuristic search algorithms like greedy best-first search. Research covers empirical and theoretical analysis of tuning strategies, multi-objective evaluation frameworks, and automated heuristic construction to improve model accuracy, efficiency, and robustness in domains such as deep learning and combinatorial optimization.

Key finding: Random search provides an effective multi-objective hyperparameter tuning mechanism for deep learning models controlling accuracy, F1-score, and model size; empirical analysis across MLP, CNN, and AlexNet shows that random... Read more
Key finding: Introducing the Goal Distance Rank Correlation (GDRC) metric enables automatic construction of heuristics tailored for greedy best-first search, overcoming pitfalls where heuristics optimized for A* actually degrade greedy... Read more
Key finding: Grid search-based hyperparameter optimization significantly improved classification performance of k-nearest neighbor and other machine learning models for breast cancer diagnosis, achieving up to 100% recall and 99.42%... Read more
Key finding: Grid search hyperparameter tuning of a hybrid CNN-LSTM model outperformed random search in accuracy (91.67%) and other classification metrics for heart disease detection, confirming the utility of systematic random search... Read more
by R Yap
Key finding: Combining white-box visualization techniques with black-box factorial design in hyperparameter tuning of stochastic local search algorithms yields better algorithm configurations than either approach alone; this integrated... Read more

All papers in Random Search

The number of descendants of a node in a binary search tree (BST) is the size of the subtree having this node as a root; the number of ascendants is the number of nodes on the path connecting this node with the root. Using a purely... more
The number of descendants of a node in a binary search tree (BST) is the size of the subtree having this node as a root; the number of ascendants is the number of nodes on the path connecting this node with the root. Using a purely... more
A randomized algorithm with stream splitting for design of heat exchanger networks is presented in this work. The algorithm has provisions for splitting any one of the process streams. We have studied three benchmark problems taken from... more
In this paper we present a new optimization algorithm based on a model of the foraging behavior of a population of primitive ants (Pachycondyla apicalis). These ants are characterized by a relatively simple but efficient strategy for prey... more
As desktop computer computational power continues to increases dramatically, it is becoming commonplace to run a combination of deadline-sensitive applications. Despite the proliferation of computational power, the detailed nature of... more
We study the role of dynamical constraints in the general problem of finding the best statistical strategy for random searching when the targets can be detected only in the limited vicinity of the searcher. We find that the optimal search... more
Recent developments in Neural Architecture Search (NAS) resort to training the supernet of a predefined search space with weight sharing to speed up architecture evaluation. These include random search schemes, as well as various schemes... more
An important problem addressed using cDNA microarray data is the detection of genes differentially expressed in two tissues of interest. Currently used approaches ignore the multidimensional structure of the data. However it is well known... more
We consider a supply chain, which consists of N stocking locations and one supplier. The locations may be coordinated through replenishment strategies and lateral transshipments, i.e., transfer of a product among locations at the same... more
In different agro-climates the greenhouse horticulture are making use of various types of plastic cover where its influence on production in relation to crop, indoor climate and outside climate not considered in selection. In this study,... more
In Ethiopia almost most greenhouses are equipped with fixed ventilation owing to the fact that its influence on CO2 concentration, indoor temperature and RH% which affects plant growth is not clearly understood or due to lack of capacity.... more
The paper gives an analysis of some optimization algorithms in computer sciences and their implementation in solving the problem of binary character recognition. The performance of these algorithms is analyzed using the Optimization... more
The problem of choosing a good parameter setting for a better generalization performance in a learning task is the so-called model selection. A nested uniform design (UD) methodology is proposed for efficient, robust and automatic model... more
This paper presents a technically advanced, interactive AI-driven interview preparation system designed to simulate realistic interview dialogues. The proposed system dynamically engages candidates by asking follow-up questions,... more
In this emerging, difficult field, obtaining the best possible patient outcomes depends on the skillful interpretation and punctuation of audiological reports. The Audiogram Digitization Tool (ADT) is a novel method to improve the... more
These days, a lot of applications, such shortlisting candidates for recruiting processes, depend on information retrieval technologies. This research study presents the use of the robust ranking algorithm Best Match 25 (BM25) for... more
The COVID-19 pandemic highlighted the need for efficient and scalable respiratory support systems in emergency and critical care settings. Despite being widely used, manual ventilation bags provide challenges in ensuring consistent... more
A theoretical and applied literature has suggested that foragers search using Lévy flights, since Lévy flights can maximize the efficiency of search in the absence of information on the location of randomly distributed prey. Foragers,... more
Slicing has been widely applied in many fields of software engineering, such as debugging, testing, software maintenance and restructuring. Several meta-heuristic search algorithms have been discussed and applied in many areas and been... more
Determinantal point processes (DPPs) are distributions over sets of items that model diversity using kernels. Their applications in machine learning include summary extraction and recommendation systems. Yet, the cost of sampling from a... more
Determinantal point processes (DPPs) are repulsive point processes that have been used for Monte Carlo integration. In this paper, we compare two ways of using DPPs for numerical integration: using the DPP sample directly as quadrature... more
The rapid advancement of Artificial Intelligence (AI) technologies is reshaping the global job market, influencing employment patterns, skill requirements, and workforce dynamics across industries. AI systems ranging from machine learning... more
A system oriented to develop an image processing system, which takes advantage of radiation flashes from a plasma focus, by optimizing the emission-detection-reconstruction procedure, is presented. A computer technique for 3D... more
Abstract—With the growth of the Internet, Internet Service Providers (ISPs) try to meet the increasing traffic demand with new technology and improved utilization of existing resources. Routing of data packets can affect network... more
India's economy is heavily reliant on agriculture, ranking among the top crop producers globally. With farm production contributing approximately 18.1 percent to the nation's GDP, it holds a pivotal role in the agribusiness sector.... more
Recent developments in the field of deep learning models for agricultural pest classification, particularly in relation to oil palm cultivation, highlight the possibility of accurate and effective pest identification. The goal of this... more
Two high-pressure insulating phases of lithium were predicted using random search and evolutionary algorithm methods with first-principles electronic structure calculations. It is shown that lithium will transform from the metallic cubic... more
This paper describes the procedure of optimizing the sector geometry of the magnet to obtain the desired isochronous field. The hill shape of the magnet is described in terms of a small number of parameters which are iteratively... more
In this paper we consider the two-dimensional (2D) rectangular packing problem, where a ®xed set of items have to be allocated on a single object. Two heuristics, which belong to the class of packing procedures that preserve bottomleft... more
Download research papers for free!