Human Generated Data

Title

Untitled (cowboys, St. Louis Fair?)

Date

c. 1904

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3161

Human Generated Data

Title

Untitled (cowboys, St. Louis Fair?)

People

Artist: Unidentified Artist,

Date

c. 1904

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Chair 99.9
Furniture 99.9
Person 99.9
Human 99.9
Person 99.7
Person 99.7
Apparel 99.6
Clothing 99.6
Person 98.7
Person 96.4
Person 95.7
Hat 78.6
Sun Hat 75.7
Cowboy Hat 72.4

Imagga
created on 2022-01-08

kin 30.3
people 20.6
man 18.8
person 17.9
male 16.3
old 16
adult 12.4
statue 11.8
outdoor 11.5
dark 10.8
sunset 10.8
couple 10.4
outdoors 10.4
happiness 10.2
two 10.2
field 10
traditional 10
art 9.9
religion 9.9
sunlight 9.8
sculpture 9.7
clothing 9.7
ancient 9.5
women 9.5
love 9.5
life 9.4
outside 9.4
travel 9.1
summer 9
uniform 8.8
soldier 8.8
country 8.8
boy 8.7
helmet 8.7
military 8.7
day 8.6
stone 8.5
culture 8.5
religious 8.4
sport 8.3
sky 8.3
park 8.2
protection 8.2
danger 8.2
happy 8.1
weapon 8.1
history 8
family 8
building 8
autumn 7.9
holiday 7.9
mother 7.7
monument 7.5
vintage 7.4
girls 7.3
cowboy 7.3
black 7.2
child 7.2
architecture 7

Microsoft
created on 2022-01-08

person 98
clothing 97.2
ground 95.1
outdoor 93.7
old 92
man 89.7
group 70.2
hat 67.5
text 59.3
posing 58.5
vintage 47.8
clothes 22.6
stone 6.7

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 54.3%
Calm 99%
Sad 0.4%
Confused 0.3%
Angry 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 99.5%
Confused 0.2%
Angry 0.1%
Sad 0.1%
Happy 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Calm 99.3%
Confused 0.2%
Sad 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 45-51
Gender Male, 99.3%
Calm 99%
Sad 0.5%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 16-24
Gender Male, 80.8%
Calm 80.3%
Happy 11.2%
Sad 5.4%
Disgusted 0.9%
Confused 0.7%
Fear 0.5%
Angry 0.5%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 93.7%
a vintage photo of a group of people posing for a picture 93.6%
a vintage photo of a group of people posing for a photo 92.7%

Text analysis

Amazon

1256

Google

1256
1256