Search Algorithms in Artificial Intelligence: Best Answers 007ET

Search Algorithms in Artificial Intelligence – Search Algorithms in AI are designed to check for an element or retrieve an element from any data structure where it is stored. Also, in computer science, a search algorithm is an algorithm (typically involving a multitude of other, more specific algorithms that solves a search problem).

Search Algorithms in Artificial Intelligence

Search algorithms work to retrieve information stored within some data structure or calculated in the search space of a problem domain, either with discrete or continuous values.

Adversarial Search Algorithms

Adversarial search is a search where we examine the problem which arises when we try to plan ahead of the world, and other agents are planning against us.

  • In previous topics, we have studied the search strategies which are only associated with a single agent that aims to find the solution which often expressed in the form of a sequence of actions.
  • But, there might be some situations where more than one agent is searching for the solution in the same search space, and this situation usually occurs in game playing.
  • The environment with more than one agent is termed as multi-agent environment, in which each agent is an opponent of other agent and playing against each other. Each agent needs to consider the action of other agent and effect of that action on their performance.
  • So, Searches in which two or more players with conflicting goals are trying to explore the same search space for the solution, are called adversarial searches, often known as Games.
  • Games are modeled as a Search problem and heuristic evaluation function, and these are the two main factors which help to model and solve games in AI.

Types of Games in AI

DeterministicChance Moves
Perfect informationChess, Checkers, go, OthelloBackgammon, monopoly
Imperfect informationBattleships, blind, tic-tac-toeBridge, poker, scrabble, nuclear war
Types of Games in AI
  • Perfect information: A game with the perfect information is that in which agents can look into the complete board. Agents have all the information about the game, and they can see each other moves also. Examples are Chess, Checkers, Go, etc.
  • Imperfect information: If in a game agents do not have all information about the game and not aware with what’s going on, such type of games are called the game with imperfect information, such as tic-tac-toe, Battleship, blind, Bridge, etc.
  • Deterministic games: Deterministic games are those games which follow a strict pattern and set of rules for the games, and there is no randomness associated with them. Examples are chess, Checkers, Go, tic-tac-toe, etc.
  • Non-deterministic games: Non-deterministic are those games which have various unpredictable events and has a factor of chance or luck. This factor of chance or luck is introduced by either dice or cards. These are random, and each action response is not fixed. Such games are also called as stochastic games.
    Example: Backgammon, Monopoly, Poker, etc.

Note: In this topic, we will discuss deterministic games, fully observable environment, zero-sum, and where each agent acts alternatively.

Zero-Sum Game in IA

  • Zero-sum games are adversarial search which involves pure competition.
  • In Zero-sum game each agent’s gain or loss of utility is exactly balanced by the losses or gains of utility of another agent.
  • One player of the game try to maximize one single value, while other player tries to minimize it.
  • Each move by one player in the game is called as ply.
  • Chess and tic-tac-toe are examples of a Zero-sum game.

Zero-sum game: Embedded thinking

The Zero-sum game involved embedded thinking in which one agent or player is trying to figure out:

  • What to do.
  • How to decide the move
  • Needs to think about his opponent as well
  • The opponent also thinks what to do

Each of the players is trying to find out the response of his opponent to their actions. This requires embedded thinking or backward reasoning to solve the game problems in AI.

Formalization of the problem

A game can be defined as a type of search in AI which can be formalized of the following elements: McDonald’s to Customize Drive-Through Windows With Artificial Intelligence.

Initial state: It specifies how the game is set up at the start.

Player(s): It specifies which player has moved in the state space.

Action(s): It returns the set of legal moves in state space.

Result(s, a): It is the transition model, which specifies the result of moves in the state space.

Terminal-Test(s): Terminal test is true if the game is over, else it is false at any case. The state where the game ends is called terminal states.

Utility(s, p): A utility function gives the final numeric value for a game that ends in terminal states s for player p. It is also called payoff function. For Chess, the outcomes are a win, loss, or draw and its payoff values are +1, 0, ½. And for tic-tac-toe, utility values are +1, -1, and 0.

Game tree in AI

A game tree is a tree where nodes of the tree are the game states and Edges of the tree are the moves by players. The game tree involves the initial state, actions function, and result Function.

Example: Tic-Tac-Toe game tree:

The following figure is showing part of the game tree for the tic-tac-toe game. Following are some key points of the game:

  • There are two players MAX and MIN.
  • Players have an alternate turn and start with MAX.
  • MAX maximizes the result of the game tree
  • MIN minimizes the result.
Adversarial Search in AI - Game tree in AI
Adversarial Search in AI – Game tree in AI

Example Explanation

  • From the initial state, MAX has 9 possible moves as he starts first. MAX place x and MIN place o, and both player plays alternatively until we reach a leaf node where one player has three in a row or all squares are filled.
  • Both players will compute each node, minimax, the minimax value which is the best achievable utility against an optimal adversary.
  • Suppose both the players are well aware of the tic-tac-toe and playing the best play. Each player is doing his best to prevent another one from winning. MIN is acting against Max in the game.
  • So in the game tree, we have a layer of Max, a layer of MIN, and each layer is called as Ply. Max place x, then MIN puts o to prevent Max from winning, and this game continues until the terminal node.
  • In this either MIN wins, MAX wins, or it’s a draw. This game-tree is the whole search space of possibilities that MIN and MAX are playing tic-tac-toe and taking turns alternately.

Hence adversarial Search for the minimax procedure works as follows:

  • It aims to find the optimal strategy for MAX to win the game.
  • It follows the approach of Depth-first search.
  • In the game tree, optimal leaf node could appear at any depth of the tree.
  • Propagate the minimax values up to the tree until the terminal node discovered.

In a given game tree, the optimal strategy can be determined by the minimax value of each node, which can be written as MINIMAX(n). MAX prefer to move to a state of maximum value, and MIN prefer to move to a state of minimum value then:

Adversarial Search in AI Adversarial Search
Adversarial Search in AI – Adversarial Search

Mini-Max Algorithm in Artificial Intelligence

  • Mini-max algorithm is a recursive or backtracking algorithm which is used in decision-making and game theory. It provides an optimal move for the player assuming that opponent is also playing optimally.
  • Mini-Max algorithm uses recursion to search through the game-tree.
  • Min-Max algorithm is mostly used for game playing in AI. Such as Chess, Checkers, tic-tac-toe, go, and various tow-players game. This Algorithm computes the minimax decision for the current state.
  • In this algorithm two players play the game, one is called MAX and other is called MIN.
  • Both the players fight it as the opponent player gets the minimum benefit while they get the maximum benefit.
  • Both Players of the game are opponent of each other, where MAX will select the maximized value and MIN will select the minimized value.
  • The minimax algorithm performs a depth-first search algorithm for the exploration of the complete game tree.
  • The minimax algorithm proceeds all the way down to the terminal node of the tree, then backtrack the tree as the recursion.

Pseudo-code for MinMax Algorithms in Artificial Intelligence

  1. function minimax(node, depth, maximizingPlayer) is  
  2. if depth ==0 or node is a terminal node then  
  3. return static evaluation of node  
  4.   
  5. if MaximizingPlayer then      // for Maximizer Player  
  6. maxEva= -infinity            
  7.  for each child of node do  
  8.  eva= minimax(child, depth-1, false)  
  9. maxEva= max(maxEva,eva)        //gives Maximum of the values  
  10. return maxEva  
  11.   
  12. else                         // for Minimizer player  
  13.  minEva= +infinity   
  14.  for each child of node do  
  15.  eva= minimax(child, depth-1, true)  
  16.  minEva= min(minEva, eva)         //gives minimum of the values  
  17.  return minEva  

Initial call:

Minimax(node, 3, true)

Working of Min-Max Algorithms in Artificial Intelligence

  • The working of the minimax algorithm can be easily described using an example. Below we have taken an example of game-tree which is representing the two-player game.
  • In this example, there are two players one is called Maximizer and other is called Minimizer.
  • Maximizer will try to get the Maximum possible score, and Minimizer will try to get the minimum possible score.
  • This algorithm applies DFS, so in this game-tree, we have to go all the way through the leaves to reach the terminal nodes.
  • At the terminal node, the terminal values are given so we will compare those value and backtrack the tree until the initial state occurs. Following are the main steps involved in solving the two-player game tree:

Step-1: In the first step, the algorithm generates the entire game tree and applies the utility function to get the utility values for the terminal states. In the below tree diagram, let’s take A as the initial state of the tree. Suppose maximizer takes first turn, which has worst-case initial value =- infinity, and minimizer will take next turn which has worst-case initial value = +infinity.

Working of Min-Max Algorithm in AI - Mini-Max Algorithm in AI
Working of Min-Max Algorithm in AI

Step 2: Now, first, we find the utility value for the Maximizer; its initial value is -∞, so we will compare each value in the terminal state with an initial value of Maximizer and determines the higher nodes’ values. It will find the maximum among them all. Difference between JDK, JRE, and JVM

  • For node D         max(-1,- -∞) => max(-1,4)= 4
  • For Node E         max(2, -∞) => max(2, 6)= 6
  • For Node F         max(-3, -∞) => max(-3,-5) = -3
  • For node G         max(0, -∞) = max(0, 7) = 7
Working of Min-Max Algorithm in AI - Mini-Max Algorithm in AI
Working of Min-Max Algorithm in AI – Mini-Max Algorithm in AI

Step 3: In the next step, it’s a turn for minimizer, so it will compare all nodes’ values with +∞ and find the 3rd layer node values.

  • For node B= min(4,6) = 4
  • For node C= min (-3, 7) = -3
Working of Min-Max Algorithm in AI - Mini-Max Algorithm in AI
Working of Min-Max Algorithm in AI – Mini-Max Algorithm in AI

Step 4: Now it’s a turn for Maximizer, and it will again choose the maximum of all nodes value and find the maximum value for the root node. There are only 4 layers; hence, we reach the root node immediately, but there will be more than 4 layers in real games.

  • For node A max(4, -3)= 4
Mini-Max Algorithm in AI
Working of Min-Max Algorithm in AI – Mini-Max Algorithm in AI

That was the complete workflow of the minimax two-player game.

Properties of Mini-Max Algorithms in Artificial Intelligence

  • Complete- Min-Max algorithm is Complete. It will definitely find a solution (if exist), in the finite search tree.
  • Optimal- Min-Max algorithm is optimal if both opponents are playing optimally.
  • Time complexity- As it performs DFS for the game-tree, so the time complexity of Min-Max algorithm is O(bm), where b is branching factor of the game-tree, and m is the maximum depth of the tree.
  • Space Complexity- Space complexity of Mini-max algorithm is also similar to DFS which is O(bm).

Limitation of the minimax Algorithms in Artificial Intelligence

The main drawback of the minimax algorithm is that it gets prolonged for complex games such as Chess, go, etc. This type of game has a huge branching factor, and the player has lots of choices to decide. This limitation of the minimax algorithm can be improved from alpha-beta pruning, which we have discussed in the next topic.

Alpha-Beta Pruning Algorithms in Artificial Intelligence

  • Alpha-beta pruning is a modified version of the minimax algorithm. It is an optimization technique for the minimax algorithm.
  • As we have seen in the minimax search algorithm that the number of game states it has to examine are exponential in depth of the tree. Since we cannot eliminate the exponent, but we can cut it to half. Hence there is a technique by which without checking each node of the game tree we can compute the correct minimax decision, and this technique is called pruning. This involves two threshold parameter Alpha and beta for future expansion, so it is called alpha-beta pruning. It is also called as Alpha-Beta Algorithm.
  • Alpha-beta pruning can be applied at any depth of a tree, and sometimes it not only prune the tree leaves but also entire sub-tree.
  • The two-parameter can be defined as:
    1. Alpha: The best (highest-value) choice we have found so far at any point along the path of Maximizer. The initial value of alpha is -∞.
    2. Beta: The best (lowest-value) choice we have found so far at any point along the path of Minimizer. The initial value of beta is +∞.
  • The Alpha-beta pruning to a standard minimax algorithm returns the same move as the standard algorithm does, but it removes all the nodes which are not really affecting the final decision but making algorithm slow. Hence by pruning these nodes, it makes the algorithm fast.

Note: To better understand this topic, kindly study the minimax algorithm.

Condition for Alpha-beta pruning in AI

The main condition required for alpha-beta pruning is:

  1. α>=β  

Key points about alpha-beta pruning in AI

  • The Max player will only update the value of alpha.
  • The Min player will only update the value of beta.
  • While backtracking the tree, the node values will be passed to upper nodes instead of values of alpha and beta.
  • We will only pass the alpha, beta values to the child nodes.

Pseudo-code for Alpha-beta Pruning in AI

  1. function minimax(node, depth, alpha, beta, maximizingPlayer) is  
  2. if depth ==0 or node is a terminal node then  
  3. return static evaluation of node  
  4.   
  5. if MaximizingPlayer then      // for Maximizer Player  
  6.    maxEva= -infinity            
  7.    for each child of node do  
  8.    eva= minimax(child, depth-1, alpha, beta, False)  
  9.   maxEva= max(maxEva, eva)   
  10.   alpha= max(alpha, maxEva)      
  11.    if beta<=alpha  
  12.  break  
  13.  return maxEva  
  14.     
  15. else                         // for Minimizer player  
  16.    minEva= +infinity   
  17.    for each child of node do  
  18.    eva= minimax(child, depth-1, alpha, beta, true)  
  19.    minEva= min(minEva, eva)   
  20.    beta= min(beta, eva)  
  21.     if beta<=alpha  
  22.   break          
  23.  return minEva  

Working of Alpha-Beta Pruning in AI

Let’s take an example of a two-player search tree to understand the working of Alpha-beta pruning

Step 1: At the first step the, Max player will start first move from node A where α= -∞ and β= +∞, these values of alpha and beta passed down to node B where again α= -∞ and β= +∞, and Node B passes the same value to its child D.

Alpha-Beta Pruning -Working of Alpha-Beta Pruning in AI
Working of Alpha-Beta Pruning in AI

Step 2: At Node D, the value of α will be calculated as its turn for Max. The value of α is compared with firstly 2 and then 3, and the max (2, 3) = 3 will be the value of α at node D, and the node value will also 3.Java Try Catch.

Step 3: Now algorithm backtrack to node B, where the value of β will change as this is a turn of Min, Now β= +∞, will compare with the available subsequent nodes value, i.e., min (∞, 3) = 3, hence at node B now α= -∞, and β= 3.

Alpha-Beta Pruning - Working of Alpha-Beta Pruning in AI
Working of Alpha-Beta Pruning in AI

In the next step, the algorithm traverse the next successor of Node B, which is node E, and the values of α= -∞and β= 3 will also be passed.

Step 4: At node E, Max will take its turn, and the value of alpha will change. The current value of alpha will be compared with 5, so max (-∞, 5) = 5, hence at node E α= 5 and β= 3, where α>=β, so the right successor of E will be pruned, and the algorithm will not traverse it, and the value at node E will be 5.

Alpha-Beta Pruning - Working of Alpha-Beta Pruning in AI
Working of Alpha-Beta Pruning in AI

Step 5: At the next step, the algorithm again backtracks the tree from node B to node A. At node A, the alpha value will be changed; the maximum available value is 3 as max (-∞, 3)= 3, and β= +∞. These two values now pass to the right successor of A, which is Node C.

At node C, α=3 and β= +∞, and the same values will be passed to node F.

Step 6: At node F, again the value of α will be compared with the left child who is 0, and max(3,0)= 3, and then compared with the right child who is 1, and max(3,1)= 3 still α remains 3, but the node value of F will become 1.

Alpha-Beta Pruning -Working of Alpha-Beta Pruning in AI
Working of Alpha-Beta Pruning in AI

Step 7: Node F returns the node value 1 to node C, at C α= 3 and β= +∞, here the value of beta will be changed, it will compare with 1 so min (∞, 1) = 1. Now at C, α=3 and β= 1, and again it satisfies the condition α>=β, so the next child of C which is G will be pruned, and the algorithm will not compute the entire sub-tree G.

Working of Alpha-Beta Pruning in AI- Alpha-Beta Pruning
Working of Alpha-Beta Pruning in AI

Step 8: C now returns the value of 1 to A here the best value for A is max (3, 1) = 3. Following is the final game tree, which is the showing the nodes which are computed and nodes which has never been computed. Hence the optimal value for the maximizer is 3 for this example.

Alpha-Beta Pruning - Working of Alpha-Beta Pruning in AI
Working of Alpha-Beta Pruning in AI

Move Ordering in Alpha-Beta pruning in AI

The effectiveness of alpha-beta pruning is highly dependent on the order in which each node is examined. Move order is an important aspect of alpha-beta pruning.

Types of Move Ordering in Alpha-Beta pruning in AI

It can be of two types:

Worst ordering: 

In some cases, alpha-beta pruning algorithm does not prune any of the leaves of the tree, and works exactly as minimax algorithm. In this case, it also consumes more time because of alpha-beta factors, such a move of pruning is called worst ordering. In this case, the best move occurs on the right side of the tree. The time complexity for such an order is O(bm).

Ideal ordering: 

The ideal ordering for alpha-beta pruning occurs when lots of pruning happens in the tree, and best moves occur at the left side of the tree. We apply DFS hence it first search left of the tree and go deep twice as minimax algorithm in the same amount of time. Complexity in ideal ordering is O(bm/2).

Rules to find good ordering

Following are some rules to find good ordering in alpha-beta pruning:

  • Occur the best move from the shallowest node.
  • Order the nodes in the tree such that the best nodes are checked first.
  • Use domain knowledge while finding the best move. Ex: for Chess, try order: captures first, then threats, then forward moves, backward moves.
  • We can bookkeep the states, as there is a possibility that states may repeat.

Search Algorithms in Artificial Intelligence FAQ

What is space search algorithm in AI?

State space search is a process used in the field of computer science, including artificial intelligence (AI), in which successive configurations or states of an instance are considered, with the intention of finding a goal state with a desired property.

Which search algorithm is best in AI?

The Greedy BFS algorithm selects the path which appears to be the best, it can be known as the combination of depth-first search and breadth-first search. Greedy BFS makes use of Heuristic function and search and allows us to take advantages of both algorithms.

What is search algorithms in artificial intelligence?

In Artificial Intelligence, Search techniques are universal problem-solving methods. Rational agents or Problem-solving agents in AI mostly used these search strategies or algorithms to solve a specific problem and provide the best result. Problem-solving agents are the goal-based agents and use atomic representation.

Related Articles

Responses

  1. My coder is trying to convince me to move to .net from PHP.
    I have always disliked the idea because of the costs.
    But he’s tryiong none the less. I’ve been using Movable-type on a variety of websites for about
    a year and am nervous about switching to another platform.
    I have heard very good things about blogengine.net. Is there a way I can transfer all my wordpress
    content into it? Any kind of help would be really appreciated!

  2. Howdy! This is my first visit to your blog! We are a group of volunteers and starting a new
    initiative in a community in the same niche. Your blog provided us
    beneficial information to work on. You have done a marvellous job!

  3. I believe that is one of the such a lot significant information for me.
    And i am happy reading your article. But should observation on few
    general issues, The web site style is great, the articles
    is in reality nice : D. Just right activity, cheers

  4. Hey I know this is off topic but I was wondering
    if you knew of any widgets I could add to my blog that automatically tweet my newest twitter updates.
    I’ve been looking for a plug-in like this for quite some time
    and was hoping maybe you would have some experience with something like this.
    Please let me know if you run into anything.
    I truly enjoy reading your blog and I look forward to
    your new updates.

  5. Thank you for the good writeup. It in fact was a amusement account it.
    Look advanced to more added agreeable from you!
    By the way, how could we communicate?

  6. Nice post. I was checking continuously this blog and I’m impressed!
    Extremely helpful information specially the last part 🙂
    I care for such info much. I was looking for this particular info for a
    long time. Thank you and good luck.

  7. I have to thank you for the efforts you have put in writing this site.
    I’m hoping to view the same high-grade content from you later on as well.
    In fact, your creative writing abilities has encouraged me to get my own website now 😉

  8. Howdy fantastic blog! Does running a blog similar to this require a massive amount work?
    I’ve no knowledge of programming but I had been hoping to start my own blog in the near future.
    Anyhow, should you have any ideas or techniques for new blog owners please share.

    I know this is off topic nevertheless I simply wanted
    to ask. Many thanks!

  9. I’ve been browsing on-line more than three hours as of late, yet I by no means found any interesting article like yours.

    It is lovely value sufficient for me. In my view, if all webmasters and
    bloggers made just right content material as you did,
    the net shall be a lot more helpful than ever before.

  10. Seo продвижение с продвинутым функционалом в большом городе Тольятти

    Лучший на сегодняшний день seo софт. Это реальный комбаин в seo, может решить разные задачи. Работает в много-потоке в приложении есть свои прокси которые считаются на сегодня лучшими.

    Переходим по гиперссылке и зарабатываем

    [url=https://goo-gl.su/OUHL]Программа для анализа сайта seo[/url]

  11. Have you ever considered writing an ebook or guest authoring
    on other blogs? I have a blog based on the same topics you discuss and would really like to have you share some stories/information. I know my subscribers
    would appreciate your work. If you are even remotely interested, feel free
    to send me an e-mail.

  12. I’m now not certain where you’re getting your
    information, but good topic. I needs to spend a while learning more
    or understanding more. Thanks for magnificent info I used to be looking for this info
    for my mission.

  13. Thank you for some other excellent article. Where else may just anyone get that type of info in such
    a perfect manner of writing? I’ve a presentation subsequent week, and I am at the
    look for such info.

  14. Have you ever considered creating an ebook or guest authoring on other websites?
    I have a blog based upon on the same subjects you discuss and would really like to have you share some stories/information. I know my audience would value your
    work. If you are even remotely interested, feel free to send me an email.

  15. Hi there! Someone in my Facebook group shared this website with us so I came to look it over.
    I’m definitely enjoying the information. I’m bookmarking and
    will be tweeting this to my followers! Great
    blog and great design.

  16. Amazing blog! Do you have any tips for aspiring writers?
    I’m planning to start my own website soon but I’m a little lost on everything.
    Would you suggest starting with a free platform like WordPress or go for a paid option? There are so many choices out there that I’m completely confused ..
    Any tips? Bless you!

  17. Hi would you mind stating which blog platform you’re working with?

    I’m planning to start my own blog in the near future but I’m having a difficult time making
    a decision between BlogEngine/Wordpress/B2evolution and Drupal.
    The reason I ask is because your layout seems different then most blogs and I’m looking for something unique.
    P.S My apologies for being off-topic but I had to ask!

  18. Right here is the right web site for everyone who would like to
    understand this topic. You understand a whole lot its almost tough to argue with you (not that I actually will
    need to…HaHa). You certainly put a fresh spin on a topic that’s been discussed for many years.

    Excellent stuff, just wonderful!

  19. This design is incredible! You most certainly know how to keep a reader amused.
    Between your wit and your videos, I was almost moved to start my own blog (well, almost…HaHa!) Great job.
    I really enjoyed what you had to say, and more than that, how you presented it.
    Too cool!