Human Generated Data

Title

Untitled (large family portrait)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17258

Human Generated Data

Title

Untitled (large family portrait)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Clothing 99.3
Shorts 99.3
Apparel 99.3
Person 98.7
Person 98.6
Person 98.3
Person 98
Person 97.2
Person 96.4
Person 94.1
Tie 92.3
Accessories 92.3
Accessory 92.3
Person 91.8
Person 87.3
Person 87.3
Female 82.1
Person 75.4
Person 74.6
People 74
Girl 66.3
Suit 65.2
Coat 65.2
Overcoat 65.2
Person 60.8
Child 59.7
Kid 59.7
Skirt 57.2
Dress 56.5
Floor 55.5

Imagga
created on 2022-02-26

person 35.7
people 31.2
adult 25.8
male 24.2
teacher 22.8
men 22.3
man 21.5
dancer 20.9
group 20.1
black 19.9
silhouette 19.9
professional 17.6
couple 16.5
women 15.8
performer 15.8
educator 15.6
sport 15.4
happy 15
portrait 14.9
lifestyle 14.4
businessman 14.1
business 14
girls 13.7
planner 12.5
active 11.7
wind instrument 11.5
boy 11.3
friends 11.3
friendship 11.2
entertainer 11.2
youth 11.1
love 11
brass 11
child 10.5
fun 10.5
kin 10.4
modern 9.8
fashion 9.8
attractive 9.8
human 9.7
sexy 9.6
life 9.6
dance 9.1
leisure 9.1
dress 9
team 9
success 8.8
clothing 8.7
smiling 8.7
bride 8.6
happiness 8.6
model 8.5
casual 8.5
outfit 8.4
pretty 8.4
hand 8.4
world 8.2
lady 8.1
player 8.1
looking 8
body 8
musical instrument 7.9
together 7.9
room 7.8
education 7.8
party 7.7
sitting 7.7
stage 7.6
dark 7.5
training 7.4
athlete 7.2
suit 7.2
sunset 7.2
celebration 7.2
handsome 7.1
smile 7.1
family 7.1
spectator 7.1

Google
created on 2022-02-26

Photograph 94.2
Black 89.5
Standing 86.4
Coat 86.3
Style 83.8
Line 82.5
Black-and-white 81.9
Suit 79
Window 76.3
Snapshot 74.3
Vintage clothing 74.1
Font 73.3
Team 71.3
Monochrome 70.7
Event 70.2
Art 67.3
Monochrome photography 67
Shorts 66.1
Room 64.3
History 63.2

Microsoft
created on 2022-02-26

person 96.4
text 95.9
clothing 87.3
man 67.9
posing 63.5

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Female, 79.3%
Surprised 63.6%
Calm 14.8%
Fear 11.7%
Happy 2.9%
Sad 1.9%
Angry 1.9%
Disgusted 1.8%
Confused 1.4%

AWS Rekognition

Age 21-29
Gender Female, 64.6%
Calm 99.2%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 96.9%
Calm 98.3%
Happy 0.8%
Sad 0.3%
Surprised 0.2%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 100%
Happy 59.3%
Sad 13.1%
Surprised 11.7%
Confused 6.1%
Disgusted 3.9%
Fear 2.3%
Calm 2.2%
Angry 1.4%

AWS Rekognition

Age 29-39
Gender Male, 96.3%
Sad 73%
Happy 9.7%
Fear 6.1%
Surprised 3.3%
Confused 2.6%
Calm 2%
Angry 1.7%
Disgusted 1.5%

AWS Rekognition

Age 27-37
Gender Male, 100%
Happy 26.4%
Calm 26.1%
Sad 24.9%
Angry 15.3%
Surprised 3.4%
Confused 1.6%
Disgusted 1.4%
Fear 0.8%

AWS Rekognition

Age 16-24
Gender Female, 52.6%
Calm 53.2%
Happy 19.1%
Surprised 7.7%
Angry 7.3%
Fear 4.5%
Sad 3.6%
Disgusted 2.5%
Confused 2.1%

AWS Rekognition

Age 45-51
Gender Male, 96.9%
Sad 38.4%
Happy 30.4%
Surprised 20.2%
Fear 5.6%
Confused 2.2%
Disgusted 1.4%
Angry 1.2%
Calm 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 92.3%

Captions

Microsoft

a group of people posing for a photo 96%
a group of people posing for the camera 95.9%
a group of people posing for a picture 95.8%

Text analysis

Amazon

KODVK
asi
YYTERIAS