Human Generated Data

Title

Untitled (people wearing coats standing outside)

Date

1947

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21705

Human Generated Data

Title

Untitled (people wearing coats standing outside)

People

Artist: John Howell, American active 1930s-1960s

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Clothing 99.3
Apparel 99.3
Accessories 99
Tie 99
Accessory 99
Person 98.8
Human 98.8
Person 98.6
Person 97.6
Person 97.1
Person 96.8
Person 96.1
Person 94.6
Tie 89.4
Sunglasses 84.9
Coat 80.9
Sunglasses 72.2
People 66.9
Portrait 64.8
Photography 64.8
Face 64.8
Photo 64.8
Parade 59.2
Doctor 56
Tie 55

Imagga
created on 2022-03-11

nurse 46.9
man 26.9
people 26.2
coat 24.4
male 23.4
adult 23.1
lab coat 23.1
clothing 22.2
metropolitan 20.8
person 19.4
professional 17.9
medical 16.8
business 15.2
men 14.6
work 14.1
doctor 14.1
ruler 14
smiling 13.7
businessman 13.2
group 12.9
worker 12.6
happy 12.5
portrait 12.3
black 12
women 11.9
team 11.6
together 11.4
old 11.1
life 11.1
hospital 11
city 10.8
religion 10.8
garment 10.7
vestment 10.7
couple 10.4
standing 10.4
adults 10.4
suit 10.4
corporate 10.3
clothes 10.3
day 10.2
two 10.2
color 10
smile 10
medicine 9.7
indoors 9.7
looking 9.6
church 9.2
occupation 9.2
travel 9.2
tourism 9.1
fashion 9
human 9
family 8.9
gown 8.9
job 8.8
office 8.8
lab 8.7
happiness 8.6
profession 8.6
architecture 8.6
face 8.5
uniform 8.4
health 8.3
window 8.2
care 8.2
history 8
handsome 8
love 7.9
40s 7.8
expertise 7.8
laboratory 7.7
student 7.7
culture 7.7
walking 7.6
teamwork 7.4
catholic 7.3
businesswoman 7.3
tourist 7.3
dress 7.2
building 7.1

Google
created on 2022-03-11

Outerwear 95.6
Hairstyle 95.1
Coat 94.5
Hat 89.3
Smile 88.6
Fashion 88.3
Sleeve 87.2
Standing 86.4
Headgear 85.1
Overcoat 84.7
Style 84
Vintage clothing 78.9
Trench coat 75.8
Uniform 74.7
Fashion design 74.3
Snapshot 74.3
Classic 73
Formal wear 72.9
Monochrome 72.5
Team 71.8

Microsoft
created on 2022-03-11

person 98.7
text 96.4
clothing 93.5
smile 86.4
fashion 78.9
man 76.6
black and white 71.3
posing 57.8
clothes 15.3

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 99.8%
Calm 90.3%
Sad 5.9%
Happy 1.1%
Fear 1.1%
Surprised 0.6%
Angry 0.4%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 37-45
Gender Male, 97%
Calm 99.8%
Sad 0.1%
Surprised 0.1%
Disgusted 0%
Happy 0%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 38-46
Gender Female, 98.4%
Calm 74.1%
Happy 12.2%
Surprised 5.6%
Sad 3.6%
Disgusted 1.5%
Fear 1%
Confused 1%
Angry 0.9%

AWS Rekognition

Age 36-44
Gender Female, 72%
Calm 93.6%
Happy 3.9%
Sad 0.9%
Surprised 0.8%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Happy 98.8%
Calm 0.6%
Surprised 0.5%
Disgusted 0.1%
Confused 0%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Female, 98.5%
Calm 78.2%
Sad 13.3%
Happy 2.6%
Surprised 2.6%
Confused 1%
Fear 0.9%
Angry 0.7%
Disgusted 0.7%

AWS Rekognition

Age 48-56
Gender Female, 98.6%
Calm 81.1%
Surprised 17.8%
Happy 0.7%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%
Fear 0%
Sad 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99%
Person 98.8%
Sunglasses 84.9%

Captions

Microsoft

a group of people posing for a photo 95.9%
a group of people posing for the camera 95.8%
a group of people posing for a picture 95.7%

Text analysis

Amazon

YT37A2-XAQOX