Human Generated Data

Title

Untitled (line of soldiers firing in snowy field)
Date

n.d.
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3565

Human Generated Data

Title

Untitled (line of soldiers firing in snowy field)

People

Artist: Unidentified Artist,

Date

n.d.

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3565

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.3
Human 99.3
Person 98.8
Person 98.7
Person 98.3
Person 98.1
Person 97.9
Person 97.7
Person 97.4
Person 96.7
Person 95.9
Screen 93.4
Electronics 93.4
Flying 90.6
Animal 90.6
Bird 90.6
Person 68.2
Transportation 67.9
Vehicle 67.9
Monitor 66.8
Display 66.8
Projection Screen 63.2
LCD Screen 59
Cruiser 56.9
Military 56.9
Ship 56.9
Navy 56.9
Person 50.8

Clarifai
created on 2023-10-25

military 99.6
war 99
army 98.8
snow 98.6
winter 98.4
people 98
aircraft 97.9
airplane 97.1
soldier 97
weapon 96.9
skirmish 95.7
gun 95.4
airport 95.4
man 93.8
group together 93.5
flight 92.8
combat 92.8
air 91.8
adult 89.7
cold 89.4

Imagga
created on 2022-01-08

picket fence 100
fence 91
barrier 63.3
snow 51
landscape 43.9
obstruction 42.1
winter 41.7
sky 37.7
cold 30.2
tree 30
trees 29.4
forest 28.7
season 25
scenic 24.6
scene 23.4
structure 22.4
ice 21.9
weather 21.5
rural 20.3
frost 19.2
outdoor 19.1
snowy 18.5
scenery 18
travel 16.9
field 16.7
country 16.7
outdoors 16.4
sun 16.1
seasonal 15.8
mountain 14.4
frozen 14.3
grass 14.2
light 14
park 13.2
clouds 12.7
tourism 12.4
sunny 12.1
freeze 11.8
horizon 11.7
wood 11.7
water 11.4
branch 11
architecture 10.9
nobody 10.9
city 10.8
frosty 10.8
woods 10.5
cloud 10.3
day 10.2
sea 10.2
ski tow 10.1
peaceful 10.1
countryside 10.1
cool 9.8
summer 9.7
building 9.6
pine 9.6
slope 9.3
house 9.2
tranquil 9.1
environment 9.1
covered 8.7
chairlift 8.5
calm 8.2
road 8.1
antenna 8.1
coast 8.1
farm 8
river 8
ski slope 8
fog 7.7
beach 7.6
path 7.6
idyllic 7.5
ski 7.5
ocean 7.5
mountains 7.4
land 7.4
black 7.2
conveyance 7.2
holiday 7.2
sunlight 7.1
wire 7.1
wooden 7

Google
created on 2022-01-08

Picture frame 94.5
Rectangle 89.6
Gesture 85.3
Tree 83.6
Sky 80.7
Parallel 77.3
Font 77.1
Art 74.6
Display device 69.5
Pole 66.8
Visual arts 66.3
Event 66.2
Snow 61.9
Monochrome photography 61.7
Monochrome 59.5
Winter 59.1
Room 58.5
Painting 53.1
Metal 52.7
Square 50.9

Microsoft
created on 2022-01-08

text 96.5
snow 89.4
aircraft 71.5
white 66.9
kitchen appliance 10.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 4-12
Gender Female, 53.9%
Calm 95.6%
Disgusted 1.6%
Sad 1.3%
Confused 0.5%
Surprised 0.4%
Angry 0.3%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 87.9%
Surprised 42.1%
Sad 17.3%
Disgusted 10.2%
Angry 8.1%
Calm 7.9%
Fear 7.7%
Happy 5.6%
Confused 1.1%

AWS Rekognition

Age 16-24
Gender Male, 99.8%
Angry 79.8%
Calm 15.3%
Sad 2.3%
Disgusted 1.4%
Confused 0.3%
Surprised 0.3%
Happy 0.3%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 97.4%
Calm 98%
Sad 0.8%
Angry 0.4%
Happy 0.3%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 35-43
Gender Male, 98.3%
Calm 47.7%
Angry 31.7%
Happy 6.9%
Sad 4.9%
Surprised 2.7%
Confused 2.3%
Fear 2.3%
Disgusted 1.5%

AWS Rekognition

Age 18-24
Gender Male, 92.2%
Happy 85.2%
Calm 8.1%
Fear 2.8%
Surprised 1.4%
Disgusted 0.9%
Sad 0.8%
Angry 0.5%
Confused 0.3%

Feature analysis

Amazon

Person
Person 99.3%
Person 98.8%
Person 98.7%
Person 98.3%
Person 98.1%
Person 97.9%
Person 97.7%
Person 97.4%
Person 96.7%
Person 95.9%
Person 68.2%
Person 50.8%

Categories

Imagga

text visuals 57.9%
nature landscape 38.4%
paintings art 2.1%

Captions

Microsoft
created on 2022-01-08

a sign above a door 54.1%
a group of men standing next to a door 30.7%