Human Generated Data

Title

Untitled (four oldest members of Methodist Church with preacher)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2507

Human Generated Data

Title

Untitled (four oldest members of Methodist Church with preacher)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.7
Apparel 99.7
Human 99.1
Person 99.1
Person 98.8
Person 97.5
Person 95.5
Footwear 95.5
Shoe 95.5
Shirt 87.9
Shoe 85.5
Shoe 78.7
Person 78.6
Tie 75.3
Accessory 75.3
Accessories 75.3
Linen 73.2
Home Decor 73.2
People 72.1
Coat 71.6
Overcoat 71.6
Suit 71.6
Sleeve 66.8
Female 64.7
Waiter 61.6
Photo 59.5
Photography 59.5
Face 59
Shorts 58.2
Sailor Suit 55.9

Imagga
created on 2022-03-05

people 37.9
male 37.7
man 37
person 34.8
adult 33.8
professional 31.2
men 29.2
nurse 27.5
women 26.9
businessman 26.5
happy 25.7
couple 25.3
business 24.3
smiling 21.7
teacher 21
businesswoman 20.9
job 20.4
life 20.1
together 19.3
corporate 18
team 17.9
two 17.8
group 17.7
portrait 17.5
standing 17.4
happiness 17.2
groom 16.3
worker 16.1
office 16.1
meeting 16
home 16
lifestyle 15.9
teamwork 15.8
indoors 14.9
executive 14.6
room 14.6
businesspeople 14.2
suit 14.2
love 14.2
educator 14.1
clothing 13.7
colleagues 13.6
talking 13.3
medical 13.2
mature 13
cheerful 13
work 12.6
mid adult 12.5
30s 12.5
family 12.5
smile 12.1
modern 11.9
40s 11.7
table 11.3
senior 11.3
patient 11.1
occupation 11
20s 11
dress 10.8
kin 10.8
hospital 10.8
bride 10.8
husband 10.7
interior 10.6
lady 10.6
looking 10.4
doctor 10.3
sitting 10.3
house 10
handsome 9.8
attractive 9.8
outfit 9.8
wife 9.5
adults 9.5
day 9.4
communication 9.2
successful 9.2
pretty 9.1
old 9.1
health 9
associates 8.9
success 8.9
working 8.8
ethnic 8.6
desk 8.5
casual 8.5
color 8.3
wedding 8.3
holding 8.3
mother 7.9
discussing 7.9
casual clothing 7.8
middle aged 7.8
two people 7.8
partnership 7.7
profession 7.7
togetherness 7.6
bouquet 7.6
clothes 7.5
new 7.3
waiter 7.2

Google
created on 2022-03-05

Sleeve 87.2
Coat 86.6
Dress 86.1
One-piece garment 81.7
Blazer 75.9
Collar 75.4
Snapshot 74.3
Monochrome photography 73.2
Hat 72.5
Event 72.4
Vintage clothing 72.3
Monochrome 70.7
Formal wear 70.2
Classic 68.2
Room 67.4
Uniform 67.4
Suit 66.2
Day dress 64.7
White-collar worker 63.9
Pattern 61.2

Microsoft
created on 2022-03-05

wall 99
person 98
standing 96.7
dress 95.8
posing 92.6
clothing 92
indoor 88.1
smile 86.4
woman 85.7
text 72.8
black 66.4
old 49.1
dressed 37.3
female 27.3
clothes 21.8

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 98.6%
Confused 82.4%
Sad 11.4%
Happy 2.3%
Calm 1.5%
Disgusted 1%
Surprised 0.8%
Angry 0.5%
Fear 0.1%

AWS Rekognition

Age 52-60
Gender Male, 99.5%
Confused 58.5%
Calm 21.3%
Sad 11.8%
Surprised 2.6%
Disgusted 2.1%
Fear 1.7%
Angry 1.6%
Happy 0.3%

AWS Rekognition

Age 48-56
Gender Male, 99.2%
Surprised 40.4%
Happy 27.3%
Fear 17.9%
Sad 12%
Calm 0.8%
Angry 0.6%
Disgusted 0.5%
Confused 0.5%

AWS Rekognition

Age 53-61
Gender Male, 99.9%
Calm 81.9%
Surprised 7.6%
Angry 3.5%
Happy 3.1%
Confused 1.7%
Disgusted 1.2%
Sad 0.6%
Fear 0.4%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Sad 62.2%
Calm 17.1%
Angry 5.2%
Happy 4.9%
Confused 4.6%
Surprised 4.1%
Disgusted 1.4%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Shoe 95.5%
Tie 75.3%
Suit 71.6%

Captions

Microsoft

a man and woman posing for a photo 85.4%
a man and a woman posing for a photo 85.3%
a man and woman posing for a picture 85.2%

Text analysis

Google

2VEEIA--ETT
--
KODVK -- 2VEEIA--ETT W
W
KODVK