Human Generated Data

Title

Untitled (soldiers and tanks in front of building)

Date

1959, printed later

People

Artist: Lester Cole, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.504

Human Generated Data

Title

Untitled (soldiers and tanks in front of building)

People

Artist: Lester Cole, American

Date

1959, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.6
Human 99.6
Person 99.5
Person 99
Person 97.8
Person 96.5
Person 96.1
Person 94.4
Person 91.9
Military 91.3
Military Uniform 91.3
Transportation 87.5
Vehicle 86.9
Person 86.5
Person 82.4
Person 80.6
Armored 80.6
Army 80.6
Person 80
Clothing 71.3
Apparel 71.3
Person 66.4
Wheel 62.5
Machine 62.5
Person 59.4
Tank 57.6
Office Building 56.9
Building 56.9

Imagga
created on 2021-12-14

university 100
architecture 37.1
city 33.3
building 33.1
sky 26.2
snow 23.6
travel 22.5
landmark 19.9
urban 17.5
trees 15.1
landscape 14.9
street 14.7
tree 14.6
water 14
park 14
stone 13.2
winter 12.8
old 12.5
house 12.4
tourism 12.4
skyline 12.4
outdoor 12.2
clouds 11.8
river 11.6
bridge 11.5
buildings 11.3
structure 11.3
famous 11.2
history 10.7
tourist 10.7
vacation 10.6
skyscraper 10.6
facade 10.3
monument 10.3
construction 10.3
town 10.2
historic 10.1
light 10
night 9.8
business 9.7
holiday 9.3
weather 9.3
statue 9.1
center 8.9
office 8.8
high 8.7
scene 8.7
cold 8.6
england 8.6
modern 8.4
road 8.1
tower 8.1
sun 8.1
mountain 8
day 7.8
forest 7.8
ancient 7.8
summer 7.7
hotel 7.6
united 7.6
cityscape 7.6
wood 7.5
exterior 7.4
natural 7.4
peaceful 7.3
new 7.3
arch 7.2
column 7.1
scenic 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 99.4
outdoor 95
black and white 90.5
person 88.7
clothing 82.8
man 71.9
car 71.5
old 70.1
building 66
white 65.7
vehicle 63.5
people 60.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-42
Gender Male, 97.6%
Calm 95.4%
Angry 2.1%
Confused 1%
Surprised 0.7%
Sad 0.5%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Male, 99.5%
Calm 84%
Angry 5.5%
Confused 4.1%
Sad 2.6%
Surprised 2.6%
Fear 0.6%
Happy 0.3%
Disgusted 0.3%

AWS Rekognition

Age 23-35
Gender Female, 57.6%
Calm 97.9%
Sad 1.3%
Confused 0.4%
Surprised 0.1%
Angry 0.1%
Happy 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 29-45
Gender Male, 93.1%
Surprised 66.3%
Calm 26.8%
Angry 6.3%
Confused 0.3%
Fear 0.2%
Sad 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Wheel 62.5%

Captions

Microsoft

a group of people sitting in front of a building 93.7%
an old photo of a group of people sitting in front of a building 92.1%
a group of people sitting in front of an old building 92%