Human Generated Data

Title

Untitled (family portrait in living room)
Date

1964
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16905

Human Generated Data

Title

Untitled (family portrait in living room)

People

Artist: Lucian and Mary Brown, American

Date

1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.2
Human 99.2
Person 98.7
Person 97.9
Person 96.4
Person 95.9
Person 94.9
Person 94.4
Person 93.7
Person 92.7
Person 91.6
Person 87.8
Furniture 86.2
Person 85.3
Accessories 83.4
Accessory 83.4
Tie 83.4
Face 82.1
Clothing 77.1
Apparel 77.1
Musical Instrument 76.2
Chair 75.4
Indoors 74.5
Musician 73.1
People 71
Leisure Activities 70.8
Suit 70.2
Overcoat 70.2
Coat 70.2
Photo 69.3
Portrait 69.3
Photography 69.3
Kid 68.7
Child 68.7
Room 66.8
Dress 59.6
Female 59
Girl 56.2
Living Room 55.3
Person 47.6

Imagga
created on 2022-02-26

man 33.7
barbershop 29.7
person 28
people 26.2
shop 25.8
male 25.6
room 23.3
adult 21.9
musical instrument 21.8
indoors 19.3
mercantile establishment 18.2
percussion instrument 17.6
happy 17.5
home 16.7
classroom 16.7
sitting 15.4
lifestyle 15.2
women 15
marimba 14.7
professional 14.7
smiling 14.5
interior 14.1
senior 14
teacher 13.8
men 13.7
business 13.4
businessman 13.2
couple 13.1
nurse 12.9
chair 12.5
place of business 12.2
cheerful 12.2
holding 11.5
medical 11.5
education 11.2
office 11.2
portrait 11
happiness 11
indoor 10.9
modern 10.5
group 10.5
casual 10.2
hand 10
to 9.7
job 9.7
child 9.7
school 9.4
two 9.3
mature 9.3
worker 9
health 9
hospital 8.8
work 8.8
two people 8.7
boy 8.7
class 8.7
table 8.6
desk 8.5
togetherness 8.5
doctor 8.5
blackboard 8.4
color 8.3
care 8.2
dress 8.1
looking 8
kid 8
clinic 7.9
standing 7.8
patient 7.7
student 7.7
exam 7.7
elderly 7.7
life 7.7
talking 7.6
communication 7.6
horizontal 7.5
enjoyment 7.5
human 7.5
one 7.5
camera 7.4
phone 7.4
occupation 7.3
black 7.2
team 7.2
day 7.1
medicine 7
together 7

Google
created on 2022-02-26

Furniture 93.6
White 92.2
Black 89.9
Chair 88.1
Black-and-white 86.7
Picture frame 84.2
Style 84
Art 79.7
Monochrome 75.4
Vintage clothing 74.9
Monochrome photography 74.9
Window 74.8
Snapshot 74.3
Classic 71.7
Suit 70.8
Event 70.6
Sitting 70.1
Room 66.8
Stock photography 65.7
Child 63.8

Microsoft
created on 2022-02-26

person 94.4
clothing 89.9
man 79.3
text 71.2
gallery 71
furniture 62.1
house 59.8
group 57.9
room 40.5
posing 37.4

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 99.1%
Sad 0.2%
Surprised 0.2%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 48-54
Gender Female, 56.1%
Happy 50.2%
Sad 28.2%
Calm 15.6%
Angry 2.1%
Confused 1.4%
Disgusted 0.9%
Fear 0.8%
Surprised 0.7%

AWS Rekognition

Age 38-46
Gender Female, 61.4%
Calm 98.6%
Happy 0.7%
Sad 0.2%
Fear 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 42-50
Gender Male, 99%
Calm 49%
Sad 16.7%
Happy 15.3%
Surprised 8.5%
Fear 4.1%
Confused 3.1%
Angry 1.7%
Disgusted 1.4%

AWS Rekognition

Age 31-41
Gender Male, 97.7%
Calm 97.9%
Sad 1%
Angry 0.4%
Confused 0.2%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 37-45
Gender Female, 50.7%
Calm 89.4%
Sad 5.2%
Happy 2.8%
Confused 0.9%
Angry 0.7%
Surprised 0.5%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 39-47
Gender Male, 98.7%
Calm 97.3%
Happy 1.4%
Sad 0.4%
Surprised 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Female, 70.2%
Sad 72.8%
Happy 18.9%
Calm 2.7%
Confused 2.3%
Disgusted 1.1%
Fear 1.1%
Angry 0.6%
Surprised 0.4%

AWS Rekognition

Age 18-24
Gender Male, 96.1%
Calm 74.1%
Sad 10.7%
Happy 7.8%
Fear 3.1%
Confused 1.5%
Angry 1.2%
Disgusted 0.9%
Surprised 0.7%

AWS Rekognition

Age 42-50
Gender Male, 86%
Calm 82.1%
Happy 9.5%
Sad 3.7%
Confused 1.3%
Surprised 1.1%
Fear 1%
Angry 0.7%
Disgusted 0.5%

AWS Rekognition

Age 29-39
Gender Female, 91.7%
Happy 94.5%
Sad 2.7%
Calm 1.4%
Surprised 0.4%
Angry 0.3%
Fear 0.3%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Female, 91.5%
Calm 43.8%
Sad 26%
Surprised 14.1%
Fear 5.4%
Confused 3.9%
Angry 2.8%
Disgusted 2.7%
Happy 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 83.4%

Captions

Microsoft

a group of people posing for a photo 80.9%
a group of people standing in a room 80.8%
a group of people in a room 80.7%

Text analysis

Amazon

5
MJ17--YT3--AON