Large language models can be used to support military tactical planning, but the technology still has several limitations. This is shown by studies from the Swedish Defence Research Agency (FOI), conducted together with Swedish officers.
Commissioned by the Swedish Armed Forces (Försvarsmakten), FOI has developed a language model adapted for military use. The tool is designed to operate in accordance with the Time-Constrained Planning (TCP) methodology, known in Swedish as Planering under tidspress (PUT), which is used in military planning processes.
The researchers' material is based on surveys, observations and focus group interviews, and the model was tested in two studies with a total of 71 participants. The first was conducted at the specialist officer training programme in Halmstad (southwestern Sweden), while the second was carried out during the Army Tactical Course at the Combat Arms School (Markstridsskolan) in Skövde (southwestern Sweden).
The results show that many officers had high expectations of the AI tool, and according to the researchers, some of these were met. The tool proved particularly useful for rapidly searching and summarising large volumes of text, such as orders, manuals and regulations. Several participants also found that the model could serve as a sounding board for ideas.
At the same time, participants highlighted several shortcomings. For instance, formulating effective instructions was found to be difficult, and many felt that verifying the accuracy of the model's responses took too much time. Another limitation concerns the handling of geographical information. The tool struggled to analyse maps and interpret images, which according to the researchers reduces its utility in military analysis.
– Several participants considered the AI tool to be inadequate when working with maps, which naturally limits the ability to carry out analyses linked to geographical information. Future AI tools therefore need to be integrated into a digitalised command support system with access to data streams from sensors on the battlefield, says Zackarias Alenljung, research engineer at FOI.
FOI nonetheless concludes that language models can already today be used to support tactical planning, particularly at higher command levels where the volume of information is large. At the same time, the researchers emphasise that the technology requires continued development, training and careful human oversight.
They also point to security concerns. The study made use of commercial language models, which entails risks related to confidentiality and data security. The researchers therefore stress that AI tools should be regarded as a complement to the planning process, not as a replacement for human decision-making.