Abstract
Foraging as a natural visual search for multiple targets has increasingly been studied in humans in recent years. Here, we aimed to model the differences in foraging strategies between feature and conjunction foraging tasks found by Á. Kristjánsson et al. Bundesen proposed the theory of visual attention (TVA) as a computational model of attentional function that divides the selection process into filtering and pigeonholing. The theory describes a mechanism by which the strength of sensory evidence serves to categorise elements. We combined these ideas to train augmented Naïve Bayesian classifiers using data from Á. Kristjánsson et al. as input. Specifically, we attempted to answer whether it is possible to predict how frequently observers switch between different target types during consecutive selections (switches) during feature and conjunction foraging using Bayesian classifiers. We formulated 11 new parameters that represent key sensory and bias information that could be used for each selection during the foraging task and tested them with multiple Bayesian models. Separate Bayesian networks were trained on feature and conjunction foraging data, and parameters that had no impact on the model’s predictability were pruned away. We report high accuracy for switch prediction in both tasks from the classifiers, although the model for conjunction foraging was more accurate. We also report our Bayesian parameters in terms of their theoretical associations with TVA parameters,
Introduction
At any given moment, people are faced with a massive amount of visual information from the environment, and because of limited processing resources, we need to choose the items that we wish to attend to. Despite decades of research, the study of visual attention is still a thriving area of cognitive science, and one of the most common ways of studying such processing has been the well-known visual search task (Á. Kristjánsson & Egeth, 2020; Wolfe, 2000). Typical visual search tasks involve searching for one target object while varying the number or complexity of distractors (Treisman, 1986; Wolfe, 1998). Other experiments involve multiple target types, but observers still search for one target of many types on a given trial (Horowitz & Wolfe, 2001; Metlay et al., 1970).
Real-world visual tasks can involve complex combinations of multiple objects and elements that require attentional selection of relevant stimuli and suppression of irrelevant information (Chun et al., 2001; Posner et al., 1980). Despite the enormous influence of the visual search experimental design, several authors have speculated that more dynamic visual tasks can provide a more realistic picture of how objects in the visual field are selected (Á. Kristjánsson & Draschkow, 2021). One such task that researchers have recently used to study how visual attention is allocated in the visual world is visual foraging, where observers are asked to select many targets, often of different types. This task may provide a better analogy for real-world selection than single-target tasks as we may encounter many possible targets during our daily interactions with the environment (Fougnie et al., 2015; Wolfe, 2013).
Investigations of foraging as a natural search process were initially performed on animals (Bukovinszky et al., 2017; Mallott et al., 2017; Pyke et al., 1997). These foraging studies often involve multiple preys of different types, and several studies suggest that predators choose a specific type of prey in a nonrandom sequence (Bond, 1983; Dawkins, 1971; Punzalan et al., 2005). Typically, these studies show that when there are multiple types of easily detectable prey (targets), predators will forage for multiple targets simultaneously during the hunt. But if the prey is difficult to detect, they will typically select only one target type repeatedly until all targets of this type have been selected and only then turn to other target types. This difference in the difficulty of searching for prey was thought to reflect that animals have limited attentional capacities and cannot search for multiple complex objects (e.g., if the prey has a masking colour, i.e., imitative colouration; Johnstone et al., 2002).
The results of computerised foraging tasks on humans have revealed similar selection patterns but have also demonstrated that most humans can adapt to target difficulty through changes in search strategies in the environment to optimise their hit rate (Cain et al., 2012; Á. Kristjánsson et al., 2014; T. Kristjánsson et al., 2018).
Á. Kristjánsson et al. (2014) investigated foraging using a classic feature/conjunction design from the visual search literature (Á. Kristjánsson & Egeth, 2020; Treisman & Gelade, 1980). In feature search, the target was distinguished by a colour that was not shared with distractors, with all objects on the screen sharing the same shape (circles). A typical visual search finding is that distinguishable targets based on a single feature will pop out during single-target visual search tasks and can be found quickly (Treisman, 1986), and the search is therefore not affected by display size. In conjunction search, the target does not have any unique features but is defined by a conjunction between targets and distractor features. For example, the targets could be red circles and green squares, and distractors could be red and green circles. During this task, search times tend to be longer as the number of distractors increases, showing that the target does not pop out among distractors (Treisman, 1986; Wolfe, 1998).
However, during foraging, where targets disappear once selected, when only one target remains, the task effectively changes to a single-target search task. According to the literature, this final target should pop out. However, T. Kristjánsson et al. (2020) showed that the reaction times for the last target were very high, in contrast to the original findings from the single-target visual search literature. These results may argue for a lessened emphasis on preattentive versus attentive processing in theories of visual search and visual foraging and visual attention more generally.
Á. Kristjánsson et al. (2014) found that observers typically behaved very differently for different foraging tasks. There were large differences in selection sequences between feature and conjunction foraging. For example, subjects were likely to switch between target types when they foraged based on a single feature (feature foraging). However, during conjunction foraging, they mostly preferred to select all instances of one target type and only switch to different target types once those were all finished. This strategy during conjunction foraging led to low switch rates where most observers switched between two types of targets only once per trial. In particular, the Á. Kristjánsson et al. (2014) study showed that during feature foraging, switches were 32.1% of the total number of selections, and runs tests revealed that the selections were more-or-less random, while for conjunction foraging, they were only 7.3% of the total number of selections and were not random according to a runs test.
Switches during foraging may be an important measure of attentional function as they can provide information about observers’ capacity for storing different target templates simultaneously and the difficulty of switching between target types during the trial. In fact, switches during conjunction foraging led to far higher switch costs where the intertarget times (the time that elapsed between selections) were much larger when observers switched between target types during conjunction than feature foraging. This is consistent with the broader literature on attentional switching and is thought to reflect the extra cost of inhibiting repetition of the previous task (Arbuthnott & Frank, 2000).
In the feature foraging condition, targets differed from distractors on a single feature, and the data in Á. Kristjánsson et al. (2014) indicated that observers could keep more than one template in their working memory simultaneously. But Kristjánsson and Kristjánsson (2018) then showed that keeping two or more items in working memory during feature foraging nevertheless led to costs in intertarget selection times over the case when observers only needed to forage for one target category. So, in the feature task, while observers seem to be able to switch between target types randomly, this is probably not quite effortless.
But we can nevertheless speculate that random selection sequences are mostly determined in a bottom-up way. Note, however, that Maljkovic and Nakayama (1994) showed that in a pop-out search task, observers respond faster to a search target with the same colour as on a previous trial than pop-out targets of another colour. The previous target primes the next target, and Wolfe et al. (2003) speculated that this process could be thought of as a form of implicit top-down guidance. If storing several templates entails costs, as Kristjánsson and Kristjánsson (2018) showed, priming may also influence performance, reflected in the increased intertarget times. At the same time, we may speculate that priming becomes dominant in the conjunction foraging condition, creating conditions where observers repeat their last target selections, using priming to overcome attentional limitations.
Another exciting issue is that complex scenes and tasks can have large numbers of objects competing for attention. Although theory of visual attention (TVA) treats all objects equally, it may be more likely that bias and salience parameters might be influenced by the distance of an object to the location of the current gaze. Hulleman and Olivers (2017), for example, suggested that all items within, what they called the functional visual field (FVF), are processed and that the FVFs are an essential parameter or unit in visual search (Young & Hulleman, 2013). The FVF can be defined as “an index of the total visual field area from which target characteristics can be acquired when eye and head movements are precluded” (Scialfa et al., 1987, p. 14). In our analyses, we speculate that each selection applied to a foraging subset may be analogous to the FVF.
Models of foraging
Bayesian optimal foraging models have been proposed in an attempt to quantify human strategies in multiple-target search and to explore whether observers adapt their strategies to complex object distribution statistics (Cain et al., 2012; Najemnik & Geisler, 2005). But it is essential to note an important difference in that these models have typically focused on foraging paradigms where the main measure of interest has been when observers leave the current area of selection (or patch) and switch to a new patch. These authors modelled ideal searches according to optimal foraging theory (OFT), previously developed to explain animal behaviour. In short, an optimal forager should stay in a place where the quantity of food in the patch is larger than the average quantity of food in the entire environment and leave when the average food quantity drops below the average in the environment (so-called patch leaving; Hutchinson et al., 2008; A. Kristjánsson et al., 2020). In other words, observers should adapt their performance according to the marginal value theorem (MVT), which states that foragers will leave a food source when the collection rate drops below the average collection rate in the environment they are in Charnov (1976). Cain and colleagues (2012) compared the performance of humans with that of modelled ideal observers. They found that observers tend to stop searching for additional targets when target presence is unlikely but persevered longer when the probability of target presence was higher. It is important to note that in Cain et al., the number of targets on trial could vary from 0 to 12, which differs from the methods by Á. Kristjánsson et al. (2014), whose data we use in this study, where a fixed number of targets was present on each trial.
Hutchinson and colleagues (2008) also tried to model a foraging paradigm where observers could move on to a new display before all targets had been finished. During the experiment, the subjects performed a computerised task of catching fish in ponds with three different distributions of the number of fish on the screen. They could move to another pond at any time, but this took some time. The result of their experiment showed that observers fished for longer in ponds where they had caught a lot of fish but preferred to stay longer than optimal, delaying their switches to a new pond far longer than optimal. However, the high success rate in the previous patch reduced the dwell time, and subjects seemed to have learned to leave earlier during the last two thirds of the experiment. In addition, Á. Kristjánsson et al. (2020) found that foraging in humans deviated from the predictions of optimal foraging concepts and that participants continued to forage within the same area for longer than expected. These findings show that in some cases, people do not act according to OFT and adapt their strategies depending on the particular situation.
But, for the current purposes, it is important to note that these models are aimed at accounting for patch-leaving behaviour in foraging and do not apply well to selection patterns within trials, as is the main focus of many measures in foraging tasks that involve two or more target types.
A more recent model of foraging performance (Clarke et al., 2021) uses a generative Bayesian model to simulate selection runs as a sampling process without replacement. While this particular model does include a parameter for the proximity of the next selection, it does not include all the other variables tested for our model. Our aim here is to investigate ways of modelling such tasks to provide insights into how visual attention operates as these tasks are performed, with particular emphasis on whether observers stick with the same target type or switch between target types on each selection.
The theory of visual attention
Our current study is aimed at investigating the mechanisms underlying foraging using the TVA proposed by Bundesen (1990). This theory was proposed as a computational system that divides the attentional selection process into two mechanisms: filtering and pigeonholing, with sensory input from the (front-end) visual system and control parameters from a high-level executive system, such as the prefrontal cortex (Bundesen et al., 2005; Duncan & Owen, 2000). TVA is based on the biased competition principle (Desimone & Duncan, 1995), and according to this idea, possible visual categorisations that assign features to objects compete (race) to be encoded in capacity-limited visual short-term memory (VSTM) before it is filled. The possible categorisations are supported by sensory evidence; however, the competition is also influenced by perceptual biases (red circle, green square, etc.) and attentional weights (important objects are weighted highly, such as the features of the objects you are searching for). TVA thus represents a mathematical formalisation of the so-called biased competition principle (Desimone & Duncan, 1995).
A central assumption in TVA is that visual recognition and attentional selection consist of making perceptual categorisations of the form “object
Bundesen (1990) divided visual recognition and attentional selection into filtering, which involves the selection of elements, and pigeonholing, which involves the selection of categories. The filtering mechanism works in the following way: for instance, if perceptual category
The pigeonholing mechanism can be described as a situation where perceptual category
Considering specifically the foraging task in Á. Kristjánsson et al. (2014), in the feature condition, targets were defined based on the colour feature or the category of the conjunction of colour and shape features. For example, in the feature foraging condition, one subject might recognise a target as a red disc by pigeonholing the collection of physical attributes into the category red disc (conjunction of features red and disc), but another subject might filter the visual input based on feature
As for the conjunction foraging condition, the target category was defined only by a conjunction of colour and shape, so the filtering mechanism became irrelevant. If an observer filtered based on the shape feature, the weights would increase for half the targets and half of the distractors. The same would happen if the observer filtered based on colour. Assuming that these properties contributed similar to the strength of sensory evidence values, the weight equation would yield the same weight for all elements in the display. So, for conjunction foraging, the pigeonholing mechanism, therefore, plays a key role from the perspective of TVA.
TVA has been found to apply well to a large number of single stimulus recognition tasks from multielement displays (see Bundesen & Habekost, 2008, 2014, for overviews). However, the application of this theory is not limited to visual attention, and TVA has been extended to areas such as memory and executive control (Logan, 2002; Logan & Gordon, 2001; Nosofsky & Palmieri, 2008). Many classic results in the literature on visual cognition have been found to be well explained by TVA, including effects of the number and spatial position of targets in studies of divided attention (Posner et al., 1978; Sperling, 1960, 1967) and the effects of consistent practice in search (Kyllingsbæk et al., 2001; Schneider & Fisk, 1982).
Overview of current goals
The goal of this work was to train a Bayesian classifier to predict switch events during feature and conjunction foraging using data from Á. Kristjánsson et al. (2014) as input. In our modelling, the Bayesian classifier determines whether a switch to a new target type occurs or whether the same target type as on the last selection is chosen. We hypothesised that TVA could provide a good mathematical explanation of behaviour during foraging and that a Bayesian classifier could serve as an approximation for key parameters of TVA. Namely, we proposed and formulated new parameters to represent key sensory and bias information that could be used for each selection during the foraging task. We chose switches as our primary aim for prediction as this measure can provide information about the storage capacity of templates and the difficulty of switching between target types.
Methods
Observers and stimuli
The data provided by Á. Kristjánsson et al. (2014) were used as input for the classifiers. Sixteen students at the University of Iceland (22–39 years old, 9 females, 5 males; M = 28.3 years, SD = 4.6 years) participated in the experiment. Additional data for seven subjects from a pilot study with an identical experimental design were also included in the input data. As switches were relatively rare events, we used this additional data to augment the data reported in Á. Kristjánsson et al. (2014) to represent these events better (see further discussion below).
During the experiment, observers had to find two target types among two types of distractors and tap them on an IPad with a display resolution of 1,024 × 768 pixels. There were 20 targets of each type and 20 distractors of each type on the screen on each experimental trial (80 items in total on the screen; Figure 1). The task was to select all targets as quickly and accurately as possible, and once selected, the targets disappeared. The observers had to finish 20 trials of each condition before the experiment finished. As explained above, the difficulty of the experiment also varied through the use of a feature/conjunction manipulation. One condition consisted of discs with different colours, so-called feature-based targets (red and green discs were target objects; blue and yellow discs were distractors or vice versa). Another condition consisted of discs and squares with different colours, the so-called conjunction task (red discs and green squares were targets; green discs and red squares were distractors or vice versa). All stimulus categories were randomised and counterbalanced between participants.

The experimental setup in Á. Kristjánsson et al. (2014). Panel A shows the feature foraging condition (where observers selected all red and green discs while ignoring blue and yellow ones, or vice versa). In this example, targets are blue and yellow discs. Solid white arrows show a sequence of blue disc selections during the task, and dashed arrows show two possible decisions: to switch to the yellow disc or continue with the sequence of blue discs. Panel B shows the conjunction foraging condition (where the task was to select all the red squares and green discs or vice versa). In this example, targets are green squares and red discs. Solid white arrows show a sequence of green square selection during the task, and dashed arrows show two possible decisions: to switch to the red disc or continue with the sequence of green squares.
Augmented Bayesian models
In this study, we used Bayesian classifiers. A Bayesian network is a graphical model that takes the structure of a directed acyclic graph (DAG). This structure contains a probabilistic representation of the dependencies (edges) between variables (nodes) of interest (Pearl, 2011) and as a graphical model has more explanatory value than other solutions like neural networks. Naïve Bayesian classifier also show better predictive ability with small data sets as input, compared with traditional methods like logistic regression (Ng & Jordan, 2001). In addition, the augmented Naïve Bayesian classifier learns connections between the feature variables to account for possible dependence between them, conditional on the class variable (BayesFusion LLC, 2017).
First, we prepared the data obtained by Á. Kristjánsson et al. (2014) and used it as input for two augmented Bayesian networks trained separately on data from the feature and conjunction tasks. These Bayesian networks were trained to predict when observers would switch between the two types of targets that would occur during the foraging task, considering that switches are rare events and are influenced by bottom-up and top-down factors. Augmented Bayesian classifiers were built using the GeNIe 3.0 academic software. Each training example from the data involved a single selection of one target from those still available at that point within the trial. As dictated by the experimental design, there were 40 targets, and therefore 40 selections per trial. Trials, where distractors were mistakenly selected, were not included (in the original study in Á. Kristjánsson et al. (2014), trials were terminated when observers selected distractors and the trials had to be repeated).
For complex visual tasks like foraging, TVA does not define which scene features influence the salience and bias parameters of the TVA formula. Therefore, data preparation involved proposing and quantifying parameters potentially useful for a predictive model from the raw selection data, and this set of discrete parameters was calculated as input data for building and training the augmented Bayesian models. Initial models were trained using the full set of parameters to predict switches (Table 1). However, not all parameters contributed equally to the prediction accuracy, and a model quantification procedure was therefore carried out to identify the most relevant parameters by comparing the Akaike information criteria (AIC) for the parameters (Vrieze, 2012).
Set of all tested parameters for feature and conjunction foraging.
Shaded parameters were pruned from further use as inputs and were not used in the final models.
All calculated parameters were based on the position of the most recently selected target. For example, if a participant had just selected a red circle at some location, that red circle became the location from where the parameters for the next potential target were calculated. Some of the parameters are self-explanatory, but others (like grouping) relied on calculations that concern multiple nearby potential targets.
Basic parameters were based on the location of other nearby objects, such as the distance to the nearest target/distractor (Figure 2A). Other parameters were more global in nature, for example, the ratio of remaining targets of one type (same type as the current selection) to the alternate type of target. As one target type was selected and depleted, the ratio of targets of the other type grew. Similarly, run-length involved measuring the recent history of selections and was calculated as the number of selected targets of the same type without interruption from an alternate selection of the other target type. Spatial grouping involved using a local area of interest around the selected target and calculating the number of alternate target types within the area of interest of the current selection (Figure 2B). Our calculation fixed the area of interest at a radius of one.

Schematic examples of parameters based on the conjunction foraging task, where T1 and T2 targets and D1 and D2 distractors. Panel A shows the location of other nearby objects concerning the selected target. Panel B shows grouping around the closest same type of target parameter based on the conjunction foraging task concerning the selected target.
After defining our parameters, we faced the problem that switching as a parameter is a rare event during foraging, particularly during the conjunction task. For feature foraging, switches were 32.1% of the total selections, whereas for conjunction foraging, they were 7.3% of the total selections. Classification of rare events is a well-known challenging problem and can often result in biased classifiers that skew the predictions in favour of the more common class to increase the overall model accuracy (Barandela et al., 2004). To address this, we artificially increased the training data with a focus on increasing switching events. All switching events in the data from the feature and conjunction tasks were selected and repeated once for the feature foraging data and three times for the conjunction foraging data. The additional data amounted to approximately 40% for the feature task and approximately 23% for the conjunction task. We chose the oversampling method for addressing the problem of rare events as a number of studies showed that oversampling is suitable for working with Naïve Bayesian classifiers (Maloof, 2003; Mohammed et al., 2020; Putri & Frieyadie, 2017). Our approach was to initially train the models on oversampled data, and following this training, test them on the actual data.
Results
Our goal was to predict switches during foraging for multiple targets in Á. Kristjánsson et al. (2014), using the previously described parameters as input for the Bayesian classifier. To evaluate the model, the accuracy of the model and expectation–maximisation (EM) log-likelihood were used. The software used in this study allows us to represent the resulting model in a graphical form for both feature (Figure 3A) and conjunction foraging (Figure 3B). We report results from models trained on the raw, original data to establish a baseline and then for models trained on the data set augmented by oversampling the rare switches.

Resulting graphical model. Red oval shows the predictive variable, and black rectangles show parameters used for prediction. Red arrows show the connection between the predictive variable and parameters used for prediction. Black arrows show correlations between nodes. Panel A demonstrates resulting model for feature foraging. Panel B demonstrates resulting model for conjunction foraging.
Before the quantification and oversampling stages, the model was trained by 10-fold cross-validation on the data. For feature foraging, the overall accuracy for switch and nonswitch events combined was 76.2%. For repeats of the same type of target selection, the accuracy was 88%, and for switch events, the accuracy was 51.3%. For conjunction foraging, the overall accuracy was 95.2%, for repeats, 99.4%, and for switch events, accuracy was 46.7%. Although the overall model accuracy was high, it was nevertheless important to improve the accuracy of the more frequent nonswitch events. As this first training stage, we decided to prune the feature foraging model (Table 2) and conjunction foraging model (Table 3) to remove parameters that did not improve the fit of the model. Parameters were removed if the difference in AIC was less than 2.0, but only if the removal also did not have a large impact on the model accuracy.
Comparison of parameters for the feature foraging model based on the AIC (values above 25 lead to overfitting of the model).
AIC: Akaike information criterion.
Distance to the closest same parameter was an exception because of the reduced accuracy of the model. Highlighted lines indicate parameters removed from the final model.
Comparison of parameters for the conjunction foraging model based on the AIC (values above 25 lead to the model overfitting).
AIC: Akaike information criterion.
Grouping around the closest another type of target parameter became an exception because of the dropped accuracy of the model. Highlighted lines indicate parameters removed from the final model.
After the pruning, the switching rate was again trained by 10-fold cross-validation on the data. For feature foraging, the overall accuracy was 78.5%, for repeats, accuracy was 92.2%, and for switches, accuracy was 49.3%. For conjunction foraging, the overall accuracy was 95.4%, for repeats, accuracy was 99.3%, and for switches, accuracy was 45.8%. Since after quantification of both models, the accuracy of predicting the switching event for feature and conjunction foraging models was less than chance (less than 50%), we decided to oversample the data (as explained above).
After oversampling, the model was again trained by 10-fold cross-validation on the oversampled data set and tested on the original data set. For the feature task, the overall accuracy was 69.5%, with a repeat accuracy of 60.7%, and for the switches, accuracy was 88.1%. For the conjunction task, the overall switching rate prediction was 92.1%. For repeats, the accuracy was 93.5%, and for switches, it was 75.7%. The models trained with oversampled switch events did drop slightly in overall accuracy, but the results were much more balanced with both switch and nonswitch events predicted at well above chance. Interestingly, for feature foraging, the accuracy for switches was higher than the more frequent nonswitches. Graphical representations of the final models are shown in Figure 3.
Discussion
Several studies have shown that selection patterns during foraging for two or more targets change as the difficulty of distinguishing targets from distractors increases, and switches may even be minimised to the point of exhaustive search within one category (Jóhannesson et al., 2016; Á. Kristjánsson et al., 2014; T. Kristjánsson et al., 2020; Ólafsdóttir et al., 2019). These studies show how run-length and the number of switches can be used to assess foraging behaviour and foraging strategies for different tasks. The prediction of switches could therefore play a key role in understanding attentional mechanisms behind visual foraging, and attentional switching and switch costs more generally (Á. Kristjánsson et al., 2020).
In this project, we tried to assess whether it is possible to predict switches during feature and conjunction foraging with Bayesian classifiers. The Bayesian networks were trained separately on feature and conjunction foraging data. In addition, the models were pruned according to the predictive value of the model parameters. The overall accuracy of the final model for feature foraging was 69.5%, and 92.1% for conjunction foraging. We also found that the accuracy of predictions of rare switching events was greater than chance (88.1% for feature foraging and 75.7% for conjunction foraging). Predicting rare events is a common problem in many data sets, but by using oversampling, we were able to improve the results to produce an accurate and less biased model of switching behaviour.
Bundesen (1990) suggested separating visual recognition and selective attention into filtering and pigeonholing. TVA was formulated based on these parameters to describe how feature information influences categorisation and selection. Our Bayesian model defined a set of explicit parameters from the foraging task that were inspired by TVA to test which parameters had the largest influence on feature and conjunction foraging. According to TVA, the filtering mechanism increases the likelihood of perceiving objects from the target category without changing the probability that they belong to a specific category. This mechanism is likely to be reflected in the selection patterns when observers perform the feature foraging task. Participants seem to select targets throughout the foraging task regardless of which colour category the previous target belongs to (e.g., they easily switch between green and red targets). In this case, it can be assumed that the “pertinence values” for these two target categories are higher than for other categories. Therefore, objects belonging to both target categories are more likely to be selected. We propose that this mechanism can be described by considering such feature foraging model parameters as the distance to the closest target of the same type, distance to the closest target of the other type, distance to the distractor (Type 1), and distance to the distractor (Type 2) as these parameters are associated with features that determine whether a candidate item belongs to one category or the other. We assume that the type of target category is not essential, and in this case, the distance between targets strongly affects whether observers decide to switch (see Tagu & Kristjánsson, 2020).
As for the conjunction condition, the most commonly observed foraging pattern was that observers stuck to a particular category throughout a foraging trial; we speculated that this corresponded to the pigeonholing mechanism as a certain category was vital for this behaviour. The pigeonholing mechanism explains objects’ categorisations determined by a decision-making bias parameter—if certain types of categorisations are relevant, then the corresponding bias values should be high, so the required types of categorisations are likely to be made. We associated this mechanism with such parameters as the ratio of targets against distractors and run-length. The ratio parameter changed depending on the number of remaining targets of the same type and the remaining targets of another type. If you imagine a situation where 10% of targets remain of the type most recently selected and 90% to 100% of targets of a different type, then the likelihood of switching during foraging increases. The value of this parameter depended on the degree to which participants preferred to select objects belonging to the same category type (the more frequent, the higher the value). This may indicate higher bias values for categories where more extended selection sequences are preferred.
Future directions
The idea that a foraging subset may be analogous to an FVF may involve a promising avenue for future research as research on FVFs has typically been carried out with eye-tracking (Hulleman & Olivers, 2017; Young & Hulleman, 2013). In a recent study, Tagu and Kristjánsson (2020) manipulated target crypticity (difficulty) during feature versus conjunction foraging and the type of effector for target selection (mouse or gaze foraging). In contrast to the results of Jóhannesson and colleagues’s study (2017), who found no differences in gaze foraging performance between feature and conjunction foraging, Tagu and Kristjánsson found effects of target crypticity and effector type on foraging strategies. They also showed that different strategies are comparable with oculomotor dynamics. Thus, feature foraging was associated with focal exploration with long fixations and short-amplitude saccades, whereas conjunction foraging was in contrast associated with ambient exploration, with short fixations and high-amplitude saccades. These results may serve as a base for additional investigation regarding FVFs to expand future models for a better understanding of foraging.
Regarding future developments based on the current work, it is important to remember that there were no parameters directly related to time. Although our primary predicted variable was a change or switch in the selection, these choices to switch were modelled as independent of other previous choices. One of the critical parameters in foraging has proved to be switch costs which denote the slowdown in target selection that occurs when observers select a different target type than they did on the last trial. A. Kristjánsson et al. (2020) found that switch costs were higher during conjunction foraging than feature foraging, which means that switching between different target types takes much longer. We plan to use a dynamic Bayesian classifier to add a temporal component to foraging models. This model’s transformation will significantly contribute to the model’s depth and more accurately implement TVA as, according to Bundesen (1990), the time component is an essential part of TVA.
Our model could also be considered in light of another influential theoretical approach for explaining foraging, the so-called OFT (Hills, 2006; Pyke et al., 1997, see also discussion above). OFT is based on the MVT, which suggests that if a predator aims to maximise the energy gain from foraging in an environment consisting of different patches with prey or food, it should leave a particular patch when the expected profit from staying drops to the expected profit from travelling, and start selecting from the next patch (Bartumeus & Catalan, 2009; Charnov, 1976). In other words, foragers should stay longer in a particular patch if travelling to the following location costs more in terms of energy or time.
These ideas can enable modelling of the optimal time that subjects spend in a patch depending on the number of objects within it and measure the cost of switching to another patch. Some early studies supported such ideas (Kamil et al., 1988; Pyke, 1978). However, recent data have suggested that humans are not optimal foragers (Hutchinson et al., 2008; A. Kristjánsson et al., 2020; Pierce & Ollason, 1987) and that foraging behaviour involves biases and factors not considered by OFT. In addition, Wolfe (2013) used a patch-leaving design, manipulating patch quality (number of berries, berry value, see also Tagu & Kristjánsson, 2022), finding differences from MVT predictions, and it has been suggested that foraging strategy may depend on the task itself. Thus, it seems that foraging behaviour is more dynamic and flexible than OFT and MVT imply. But, for the current purposes, it is important to note that these models are aimed at accounting for patch-leaving behaviour in foraging and do not apply well to selection patterns within trials, as is the main focus of many measures in foraging tasks that involve two or more target types. Our aim here has been to investigate ways of modelling such tasks to provide insights into how visual attention operates as these tasks are performed (see Clarke et al., 2021, for a recently proposed Bayesian model of foraging).
Our current data do not involve measures of patch leaving, and such paradigms would seem to be an important future direction of study. Although our data looked at switches within a single display, or “patch,” there may be potential overlaps in how single-screen foraging can be envisioned. For example, complex single screens may be treated strategically by participants where they consider regions or quadrants as separate patches to explore, and OFT might be able to reveal this strategy. Particularly interesting might be to apply OFT to FVFs to determine whether OFT might predict short saccades within an FVF versus longer saccades to locations outside the FVF.
It is also worth noting that individual differences were found in Á. Kristjánsson’s et al.’s (2014) work, in particular, observers who switched frequently in both feature and conjunction conditions (so-called super foragers). However, Kristjánsson et al. (2018) showed that setting a time limit for each trial leads to more frequent switches regardless of task difficulty. Tagu and Kristjánsson (2022) also showed that during gaze-conjunction foraging “super foragers” had a higher number of runs than normal foragers and intermediate foragers (behaving like super foragers during mouse foraging but acting as normal foragers during gaze foraging) but they made a higher number of errors than intermediate foragers, who made more errors than normal foragers. So, the jury is still out on the role of individual differences, and we believe it is premature to try to address this issue with the current models of foraging. Clarke and colleagues (2021), however, have had success in discovering parameters for individual foragers in their recent model.
Conclusion
In this study, we highlighted several key contributions to the understanding of foraging from a TVA perspective. We defined a set of parameters that might best approximate the filtering and pigeonholing mechanisms in TVA and tested how well these parameters predicted target switching using Bayesian classifiers. We created separate Bayesian classifiers for feature and conjunction foraging using data from Á. Kristjánsson et al. (2014) and achieved high accuracy in predicting rare switching events. Given that the roles of pigeonholing and filtering should differ across feature and conjunction search, we tested the degree to which our parameters differed for these two tasks. The Bayesian approach to foraging seems to be a promising start for a deeper understanding of underlying mechanisms of attentional selection.
Supplemental Material
sj-docx-1-qjp-10.1177_17470218221094572 – Supplemental material for Bayesian approximations to the theory of visual attention (TVA) in a foraging task
Supplemental material, sj-docx-1-qjp-10.1177_17470218221094572 for Bayesian approximations to the theory of visual attention (TVA) in a foraging task by Sofia Tkhan Tin Le, Árni Kristjánsson and W Joseph MacInnes in Quarterly Journal of Experimental Psychology
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
