Human Generated Data

Title

Untitled (family of four on couch with dog)

Date

c. 1950

People

Artist: Lainson Studios,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21860

Human Generated Data

Title

Untitled (family of four on couch with dog)

People

Artist: Lainson Studios,

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Human 98.9
Person 98.9
Apparel 98.6
Clothing 98.6
Person 97.4
Chair 95.8
Furniture 95.8
Face 95.7
Mammal 94.4
Canine 94.4
Dog 94.4
Animal 94.4
Pet 94.4
Person 94.2
Lamp 94
Table Lamp 94
Person 92.7
Smile 89.7
Lighting 85.5
Person 81.9
Overcoat 81.2
Suit 81.2
Coat 81.2
People 75.9
Tie 75.1
Accessories 75.1
Accessory 75.1
Shirt 74.5
Photo 74
Portrait 74
Photography 74
Female 73.6
Child 63.3
Kid 63.3
Girl 61.6
Dress 60.8
Man 59.3
Bridegroom 58.5
Wedding 58.5
Table 58.3
Robe 56
Fashion 56
Gown 56

Imagga
created on 2022-03-11

man 39.8
person 39.5
people 37.9
male 31.2
adult 31
nurse 28.9
lab coat 26.7
business 26.7
coat 25.5
businessman 24.7
office 24.1
indoors 23.7
professional 23.6
smiling 23.1
businesspeople 21.8
meeting 21.7
team 21.5
happy 21.3
men 20.6
colleagues 20.4
working 20.3
patient 20.3
group 20.2
businesswoman 20
worker 19.9
sitting 19.8
room 19.4
couple 18.3
women 18.2
desk 17.9
together 17.5
table 17.3
talking 17.1
home 16.7
40s 16.5
work 16.5
portrait 16.2
teamwork 15.8
casual 15.3
medical 14.1
mature 13.9
cheerful 13.8
computer 13.6
hospital 13.6
senior 13.1
kin 13
smile 12.8
laptop 12.8
day 12.6
lifestyle 12.3
doctor 12.2
corporate 12
20s 11.9
30s 11.5
four 11.5
executive 11.2
camera 11.1
indoor 11
mid adult 10.6
teacher 10.3
manager 10.2
happiness 10.2
boardroom 9.9
casual clothing 9.8
health 9.7
garment 9.7
looking 9.6
horizontal 9.2
life 9.2
successful 9.2
hand 9.1
clinic 9.1
coworkers 8.8
medicine 8.8
discussion 8.8
middle aged 8.8
illness 8.6
face 8.5
two 8.5
drink 8.4
world 8.3
color 8.3
occupation 8.2
care 8.2
confident 8.2
technology 8.2
suit 8.1
clothing 8.1
grandma 8
four people 7.9
associates 7.9
discussing 7.9
forties 7.8
education 7.8
waiter 7.8
laboratory 7.7
modern 7.7
elderly 7.7
twenties 7.6
communication 7.6
keyboard 7.5
fun 7.5
grandfather 7.4
presentation 7.4
student 7.4
employee 7.2
sick person 7.1
family 7.1
job 7.1

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

clothing 92.4
text 88.4
person 86.7
man 81.6
smile 65.8
old 51.6
posing 43.6

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 77.4%
Angry 38.4%
Surprised 33.9%
Fear 9.1%
Sad 8.1%
Calm 4.3%
Happy 4.1%
Disgusted 1.5%
Confused 0.6%

AWS Rekognition

Age 35-43
Gender Female, 65.8%
Happy 99.2%
Surprised 0.5%
Calm 0.1%
Angry 0%
Disgusted 0%
Sad 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 33-41
Gender Male, 98.2%
Calm 74%
Sad 22.3%
Confused 1.8%
Happy 0.7%
Surprised 0.5%
Disgusted 0.3%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 96.8%
Calm 64.8%
Happy 16.7%
Sad 10.3%
Surprised 2.5%
Angry 1.8%
Disgusted 1.6%
Fear 1.3%
Confused 0.9%

AWS Rekognition

Age 33-41
Gender Female, 71.5%
Calm 72.5%
Happy 10.3%
Sad 9.1%
Disgusted 3.1%
Confused 1.8%
Surprised 1.5%
Angry 1.1%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Dog 94.4%
Tie 75.1%

Captions

Microsoft

a group of people posing for a photo 81.5%
a group of people posing for the camera 81.4%
a group of people posing for a picture 81.3%