Human Generated Data

Title

Unions Tangle on Waterfront

Date

1953

People

Artist: Paul Burgess, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.30

Human Generated Data

Title

Unions Tangle on Waterfront

People

Artist: Paul Burgess, American 20th century

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 100
Apparel 100
Person 99.3
Human 99.3
Hat 99.2
Person 99
Person 98
Person 98
Sun Hat 94.6
Hat 85.7
Person 84.9
Person 82
Cowboy Hat 81.7
Military 77.1
Military Uniform 75.7
People 72.2
Officer 64.8
Overcoat 57.2
Coat 57.2

Imagga
created on 2022-01-23

man 26.2
person 24.7
banjo 22.9
people 20.6
stringed instrument 20.3
male 20
statue 18.1
musical instrument 17.9
adult 15
old 14.6
portrait 14.2
world 14.2
sculpture 13.7
black 13.2
art 12.1
ancient 11.2
men 11.2
religion 10.7
family 10.7
couple 10.4
monument 10.3
architecture 10.1
mask 10
city 10
nurse 9.6
war 9.6
love 9.5
culture 9.4
dress 9
uniform 9
clothing 9
history 8.9
to 8.8
happy 8.8
marble 8.7
antique 8.7
bride 8.6
girls 8.2
soldier 7.8
army 7.8
sepia 7.8
god 7.6
fashion 7.5
historical 7.5
vintage 7.4
room 7.4
care 7.4
historic 7.3
patient 7.3
face 7.1
happiness 7.1
travel 7

Google
created on 2022-01-23

Hat 93.3
Sun hat 86.5
Gesture 85.3
Fedora 82.8
Headgear 81.5
Vintage clothing 72.9
Crew 70.8
Cowboy hat 70.1
Photo caption 67.6
Monochrome photography 67.4
Monochrome 67.1
Event 66.8
Suit 65
Stock photography 63.6
Room 61.2
Cap 60.5
Font 59.2
Art 59
History 57.9
Team 54.6

Microsoft
created on 2022-01-23

person 99.9
clothing 97.5
man 94.4
hat 93.1
text 90.7
fashion accessory 77.2
human face 76.1
old 56.2
cowboy hat 55.1
posing 53.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-70
Gender Male, 100%
Calm 45.8%
Sad 30.3%
Confused 12.7%
Disgusted 3.5%
Angry 2.7%
Happy 2.3%
Fear 1.5%
Surprised 1%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 85.7%
Happy 4.8%
Fear 2.8%
Confused 2.4%
Surprised 1.5%
Sad 1.3%
Angry 0.8%
Disgusted 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.2%
Calm 66.3%
Surprised 11.5%
Angry 10.3%
Happy 4.1%
Confused 3.5%
Fear 2%
Disgusted 1.6%
Sad 0.7%

AWS Rekognition

Age 33-41
Gender Male, 99.2%
Sad 69.4%
Calm 12.9%
Happy 8%
Confused 3.2%
Angry 2.4%
Disgusted 1.8%
Fear 1.5%
Surprised 0.9%

AWS Rekognition

Age 48-56
Gender Male, 95.7%
Happy 45.8%
Angry 42.8%
Disgusted 3%
Confused 2.9%
Sad 2.3%
Fear 1.2%
Surprised 1.1%
Calm 0.9%

AWS Rekognition

Age 18-24
Gender Male, 83.2%
Calm 93.2%
Happy 3.8%
Disgusted 0.7%
Fear 0.6%
Surprised 0.6%
Sad 0.6%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 26-36
Gender Male, 88.9%
Calm 51.3%
Sad 24.4%
Fear 10.3%
Angry 8.2%
Surprised 1.9%
Confused 1.6%
Happy 1.2%
Disgusted 1%

Microsoft Cognitive Services

Age 49
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Hat 99.2%

Captions

Microsoft

a group of people posing for a photo 96.5%
a group of people posing for the camera 96.4%
an old photo of a group of people posing for the camera 95.5%