Human Generated Data

Title

Untitled (seven family members smiling at young man in military uniform inside living room)
Date

1949
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9235

Human Generated Data

Title

Untitled (seven family members smiling at young man in military uniform inside living room)

People

Artist: Martin Schweig, American 20th century

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.8
Apparel 99.8
Person 99.7
Human 99.7
Person 99.3
Person 99.2
Person 98.2
Person 97.4
Person 97.2
Person 96.8
Person 94
Dress 91.8
Person 82.2
Home Decor 80.4
Suit 80.2
Coat 80.2
Overcoat 80.2
Face 75.4
Sleeve 73.1
Icing 72.4
Food 72.4
Dessert 72.4
Cake 72.4
Cream 72.4
Creme 72.4
Furniture 71
Chair 69.3
People 68.1
Female 66.6
Portrait 66.4
Photography 66.4
Photo 66.4
Indoors 65.9
Head 65
Hat 62
Officer 61.6
Military Uniform 61.6
Military 61.6
Sailor Suit 59.6
Kid 57.8
Child 57.8
Costume 56
Shirt 55.8
Room 55.3

Imagga
created on 2022-01-23

people 37.9
man 37.6
senior 37.5
person 35.8
male 29.8
patient 27.7
home 26.3
nurse 26.2
elderly 25.8
adult 25.1
medical 24.7
happy 23.2
indoors 22.8
mature 22.3
hospital 21.8
health 21.5
couple 20.9
smiling 20.3
old 20.2
doctor 19.7
portrait 19.4
men 18.9
grandma 18.7
illness 18.1
looking 17.6
lifestyle 17.3
professional 16.7
retired 16.5
retirement 16.3
casual 16.1
women 15.8
care 15.6
camera 14.8
office 14.7
family 14.2
happiness 14.1
clothing 13.9
room 13.8
worker 13.8
60s 13.7
two people 13.6
aged 13.6
husband 13.4
businessman 13.2
together 13.1
older 12.6
coat 12.5
kin 12.3
business 12.1
mother 12
day 11.8
clinic 11.6
medicine 11.4
wife 11.4
face 11.4
human 11.2
sitting 11.2
occupation 11
work 11
horizontal 10.9
lab coat 10.8
70s 10.8
case 10.7
enjoying 10.4
holding 9.9
team 9.9
gray hair 9.9
modern 9.8
job 9.7
30s 9.6
computer 9.6
talking 9.5
inside 9.2
indoor 9.1
grandfather 9
cheerful 8.9
group 8.9
sixties 8.8
surgery 8.8
love 8.7
age 8.6
smile 8.6
teamwork 8.3
active 8.3
businesswoman 8.2
uniform 8.1
to 8
working 8
hair 7.9
senior adult 7.9
look 7.9
seniors 7.9
standing 7.8
half length 7.8
colleagues 7.8
life 7.7
sick 7.7
attractive 7.7
sick person 7.7
profession 7.7
surgeon 7.6
pensioner 7.6
meeting 7.5
drink 7.5
treatment 7.3
lady 7.3
color 7.2
interior 7.1

Google
created on 2022-01-23

Hat 85.7
People 78.4
Art 74.9
Snapshot 74.3
Vintage clothing 73.8
Monochrome 72.7
Monochrome photography 68.9
Room 68.8
Apron 67.6
Sun hat 65.2
Stock photography 62.7
Nurse 62.4
Suit 62
History 58.9
Pattern 58.5
Toddler 57.9
Illustration 57.6
Uniform 57.4
Cooking 56.9
Curtain 55.5

Microsoft
created on 2022-01-23

person 99.7
clothing 96.9
text 95.9
standing 91.8
woman 78.3
dress 72.2
footwear 62.9
posing 50.8
man 50.2

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Female, 97.8%
Happy 80.5%
Sad 6.2%
Calm 6.2%
Surprised 2.5%
Fear 1.3%
Angry 1.2%
Disgusted 1.2%
Confused 0.8%

AWS Rekognition

Age 27-37
Gender Male, 72.1%
Calm 28.2%
Sad 24.2%
Happy 17.4%
Fear 15.3%
Surprised 8.8%
Disgusted 2.2%
Confused 2%
Angry 1.9%

AWS Rekognition

Age 25-35
Gender Female, 64.1%
Sad 84.3%
Calm 14.9%
Confused 0.2%
Happy 0.2%
Fear 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 54-64
Gender Male, 99.7%
Calm 99%
Sad 0.4%
Surprised 0.2%
Happy 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 16-22
Gender Female, 55.3%
Calm 98.1%
Sad 1.6%
Fear 0.1%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 10-18
Gender Female, 94.2%
Calm 87.9%
Sad 7.3%
Happy 3.1%
Surprised 0.6%
Confused 0.3%
Disgusted 0.3%
Fear 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 94.1%
a group of people posing for the camera 94%
a group of people posing for a picture 93.9%

Text analysis

Amazon

rt

Google

38a $2
38a
$2