Human Generated Data

Title

Untitled (group of men on a tank)

Date

1959, printed later

People

Artist: Lester Cole, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.506

Human Generated Data

Title

Untitled (group of men on a tank)

People

Artist: Lester Cole, American

Date

1959, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Military 99.7
Person 99.3
Human 99.3
Military Uniform 99.1
Person 97.9
Army 95.1
Armored 95.1
Person 90.5
Transportation 87.5
Person 86
Vehicle 85.8
Cruiser 85.3
Navy 85.3
Ship 85.3
Tank 84.8
People 82
Soldier 78.9
Battleship 70
Officer 65
Watercraft 56.8
Vessel 56.8
Troop 56
Person 47.1

Imagga
created on 2021-12-14

statue 79.1
sculpture 45.3
monument 44.9
city 30
architecture 27.9
history 27.8
sky 26.8
landmark 26.2
old 23
horse 22.8
art 22.2
travel 20.4
ancient 19.9
culture 19.7
historic 19.3
tourism 18.2
bronze 18
famous 16.8
building 16.2
religion 16.1
stone 16
device 14.9
fin 14.8
king 14.6
background 13.9
historical 13.2
memorial 12.8
symbol 12.8
saint 12.5
tourist 12.1
man 11.5
town 11.1
stabilizer 11.1
soldier 10.8
comic book 10.7
screen 10.5
capital 10.4
column 9.6
antique 9.5
catholic 8.8
display 8.7
war 8.7
weapon 8.3
sword 8.3
figure 8.2
square 8.2
urban 7.9
rider 7.9
roman 7.8
military 7.7
structure 7.7
horizontal 7.5
cross 7.5
religious 7.5
fountain 7.4
center 7.1
male 7.1
carving 7.1
park 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 99.8
person 75.7
ship 55.3

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 97.3%
Calm 83%
Angry 6.6%
Confused 3.4%
Sad 3.1%
Happy 2.2%
Surprised 0.7%
Disgusted 0.5%
Fear 0.5%

AWS Rekognition

Age 31-47
Gender Male, 98.9%
Angry 54%
Calm 18.8%
Happy 8.9%
Fear 5.9%
Sad 5.3%
Confused 3.3%
Surprised 2.1%
Disgusted 1.7%

AWS Rekognition

Age 33-49
Gender Male, 99.2%
Calm 94.4%
Angry 2.5%
Happy 2%
Sad 0.4%
Disgusted 0.4%
Confused 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 23-37
Gender Female, 89.9%
Sad 96.9%
Calm 2%
Fear 0.6%
Happy 0.2%
Angry 0.2%
Confused 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 29-45
Gender Male, 87.2%
Confused 78.5%
Calm 9.6%
Sad 7.3%
Angry 1.5%
Surprised 1.3%
Fear 0.8%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 36-52
Gender Female, 84.4%
Calm 74.3%
Fear 10.9%
Surprised 5.2%
Angry 3.5%
Sad 3.2%
Happy 2.3%
Confused 0.4%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people riding on the back of a man 66.4%
a group of people riding on the back of a motorcycle 43.3%
a group of men riding on the back of a man 43.2%

Text analysis

Amazon

ROPIO

Google

ROPIO
ROPIO