Human Generated Data

Title

Untitled (family portrait in living room)

Date

c. 1960

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21596

Human Generated Data

Title

Untitled (family portrait in living room)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Apparel 99.9
Clothing 99.9
Person 99.6
Human 99.6
Person 99.4
Person 98.9
Shorts 98.6
Shoe 98.5
Footwear 98.5
Person 98.4
Person 97.6
Person 94.7
Dress 89.4
Shoe 88.5
Coat 84.8
Suit 84.8
Overcoat 84.8
People 84.2
Face 80.6
Accessories 80.2
Tie 80.2
Accessory 80.2
Female 78.9
Couch 74.3
Furniture 74.3
Chair 70.7
Sleeve 70.3
Child 70
Kid 70
Shirt 67.2
Girl 66.7
Photography 63.6
Portrait 63.6
Photo 63.6
Tuxedo 58.2
Woman 56.2
Floor 56.1
Pants 55.2
Shoe 54.8
Shoe 51.9
Shoe 51.3

Imagga
created on 2022-03-05

kin 65.4
people 33.5
man 32.9
male 31.2
couple 27.9
happy 26.9
adult 26.4
professional 24.7
businessman 23
person 22
groom 20.6
business 20
men 19.7
corporate 18.9
attractive 18.2
team 17.9
suit 17.4
worker 17.1
nurse 17.1
smiling 16.6
smile 16.4
portrait 16.2
group 16.1
office 16.1
senior 15.9
happiness 15.7
bride 15.5
businesswoman 15.4
job 15
love 15
teamwork 14.8
dress 14.5
handsome 14.3
women 14.2
meeting 14.1
manager 14
grandfather 13.8
wedding 13.8
home 13.6
elderly 13.4
work 13.3
indoors 13.2
clothing 13
two 12.7
building 12.7
day 12.6
businesspeople 12.3
coat 12.3
patient 12.2
success 12.1
sitting 12
occupation 11.9
pretty 11.9
lab coat 11.8
mid adult 11.6
lifestyle 11.6
working 11.5
together 11.4
mature 11.2
executive 10.8
colleagues 10.7
family 10.7
face 10.7
medical 10.6
profession 10.5
marriage 10.4
looking 10.4
black 10.2
successful 10.1
old 9.8
married 9.6
bow tie 9.6
casual 9.3
garment 9.1
health 9
cheerful 8.9
grandma 8.9
partner 8.7
hands 8.7
30s 8.7
diversity 8.6
partnership 8.6
bright 8.6
career 8.5
bouquet 8.5
hospital 8.4
company 8.4
holding 8.3
human 8.2
new 8.1
husband 7.9
coworkers 7.9
handshake 7.8
standing 7.8
flowers 7.8
color 7.8
leadership 7.7
workplace 7.6
ethnic 7.6
mother 7.6
doctor 7.5
outdoors 7.5
father 7.4
20s 7.3
indoor 7.3
room 7.3
celebration 7.2
romantic 7.1
employee 7.1
modern 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

clothing 98.4
person 96
footwear 92.8
text 90
standing 89.8
posing 88.4
black and white 85.1
woman 78
smile 77.6

Face analysis

Amazon

AWS Rekognition

Age 33-41
Gender Male, 100%
Sad 43.8%
Angry 31%
Happy 9.7%
Calm 4.7%
Disgusted 4.5%
Surprised 2.9%
Fear 1.8%
Confused 1.5%

AWS Rekognition

Age 34-42
Gender Male, 97%
Confused 25.1%
Sad 18.6%
Disgusted 17.9%
Happy 13.2%
Calm 11%
Surprised 10.4%
Angry 2.4%
Fear 1.3%

AWS Rekognition

Age 36-44
Gender Male, 100%
Happy 39.5%
Surprised 24.3%
Calm 20%
Confused 8%
Sad 4.6%
Fear 1.4%
Disgusted 1.3%
Angry 0.9%

AWS Rekognition

Age 42-50
Gender Male, 99.4%
Sad 89.2%
Calm 5.6%
Confused 3.2%
Happy 0.9%
Angry 0.4%
Disgusted 0.4%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Sad 53.9%
Happy 19.1%
Confused 18.1%
Disgusted 5.8%
Surprised 1.1%
Fear 0.8%
Angry 0.7%
Calm 0.6%

AWS Rekognition

Age 27-37
Gender Male, 99.3%
Calm 98.8%
Surprised 0.4%
Confused 0.3%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0%
Happy 0%

Feature analysis

Amazon

Person 99.6%
Shoe 98.5%
Tie 80.2%
Couch 74.3%

Captions

Microsoft

a group of people posing for a photo 96.6%
a group of people posing for the camera 96.5%
a group of people posing for a picture 96.4%

Text analysis

Amazon

pr