Human Generated Data

Title

Untitled (family portrait at anniversary party)

Date

c. 1960

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21615

Human Generated Data

Title

Untitled (family portrait at anniversary party)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Apparel 99.9
Clothing 99.9
Person 99.7
Human 99.7
Person 99.4
Person 99.1
Person 98.9
Overcoat 98.2
Coat 98.2
Dress 98
Person 97.3
Person 96.1
Female 93.4
Accessories 93
Tie 93
Accessory 93
Shorts 92.9
Face 88.3
Tuxedo 84.8
Shirt 84.5
People 82.5
Woman 77
Tie 76.7
Sleeve 75
Wedding 73.7
Bridegroom 73.7
Outdoors 73.5
Plant 72.2
Suit 71.8
Girl 71.7
Portrait 69.8
Photo 69.8
Photography 69.8
Long Sleeve 69.7
Robe 67.1
Fashion 67.1
Gown 66.1
Kid 64.7
Child 64.7
Pants 64.5
Man 62.7
Flower 62
Blossom 62
Leisure Activities 60.5
Wedding Gown 59.9
Stage 58.9
Head 58.9
Shoreline 58.3
Sea 58.3
Coast 58.3
Nature 58.3
Water 58.3
Ocean 58.3
Sailor Suit 58.1
Furniture 56
Table 56
Dining Table 56

Imagga
created on 2022-03-05

golfer 69
person 59.8
player 53.7
nurse 53.4
man 46.4
professional 45
doctor 44.2
contestant 43.1
people 42.4
medical 38.9
male 36.9
team 35.9
group 34.7
hospital 33.3
job 32.8
business 31
medicine 30
adult 29.7
happy 29.5
occupation 28.4
men 28.4
work 28.3
uniform 28
worker 27.8
businessman 27.4
coat 26.6
portrait 26.5
health 25
stethoscope 24.7
patient 24.4
smiling 23.2
care 22.2
clinic 22
doctors 21.6
mature 21.4
smile 21.4
teamwork 20.4
standing 20
women 19.8
lab coat 19.8
looking 19.2
confident 18.2
profession 18.2
working 17.7
staff 17.4
corporate 16.3
handsome 16.1
human 15
company 14.9
clinical 14.7
practitioner 14.6
suit 14.6
office 14.5
diversity 14.4
together 14
surgeon 13.9
specialist 13.9
casual 12.7
colleagues 12.6
elderly 12.5
case 12.3
success 12.1
successful 11.9
physician 11.7
workers 11.7
30s 11.5
couple 11.3
student 11.3
senior 11.3
two 11
happiness 11
employee 10.9
businesswoman 10.9
black 10.8
laboratory 10.6
crowd 10.6
sick person 10.6
confidence 10.5
lifestyle 10.1
friendly 10.1
silhouette 9.9
modern 9.8
old 9.8
expertise 9.7
practice 9.7
sick 9.7
partnership 9.6
hands 9.6
illness 9.5
meeting 9.4
executive 9.3
lady 8.9
life 8.8
consultant 8.8
light 8.8
ill 8.8
bright 8.6
fresh 8.5
attractive 8.4
manager 8.4
camera 8.3
healthy 8.2
cheerful 8.1
building 7.9
businessmen 7.8
assistant 7.8
employment 7.7
architect 7.7
mid adult 7.7
exam 7.7
businesspeople 7.6
tie 7.6
career 7.6
clothing 7.5
treatment 7.4
family 7.1
day 7.1

Google
created on 2022-03-05

Black 89.5
Hat 88.3
Black-and-white 84.9
Style 84.1
Shorts 83.1
Monochrome photography 77.2
Monochrome 76.2
Vintage clothing 76.1
Snapshot 74.3
Event 72.7
Eyewear 71.7
Fashion design 71.5
Uniform 69.5
Formal wear 69.4
Crew 67.9
Font 67.3
Stock photography 64.9
Room 64.2
Team 60.5
Recreation 55

Microsoft
created on 2022-03-05

text 96.8
person 96.2
clothing 94.6
posing 93
outdoor 92.2
smile 81.6
standing 76.7
man 70.6
woman 70.2
black and white 55
female 25.7

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 95.4%
Happy 35.1%
Surprised 31%
Calm 13.9%
Sad 9%
Confused 4.9%
Fear 2.8%
Disgusted 1.9%
Angry 1.4%

AWS Rekognition

Age 45-51
Gender Male, 85.3%
Surprised 76.9%
Happy 10.6%
Confused 5.8%
Sad 3.3%
Disgusted 1.4%
Calm 1.3%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 49-57
Gender Male, 100%
Sad 67.3%
Calm 21.5%
Angry 5.6%
Confused 2.2%
Disgusted 1.5%
Happy 1.2%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Surprised 33%
Happy 20.7%
Confused 19.8%
Calm 12.4%
Sad 7.3%
Disgusted 2.5%
Angry 2.4%
Fear 2%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Sad 71.1%
Calm 6.9%
Surprised 5.6%
Confused 4.6%
Happy 4.3%
Angry 3.3%
Fear 2.2%
Disgusted 2%

AWS Rekognition

Age 54-62
Gender Male, 98.4%
Happy 99.9%
Calm 0%
Surprised 0%
Confused 0%
Disgusted 0%
Angry 0%
Sad 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 93%
Suit 71.8%

Captions

Microsoft

a group of people posing for a photo 95.7%
a group of people posing for the camera 95.6%
a group of people posing for a picture 95.5%

Text analysis

Amazon

KODAK-SVEELA

Google

YT37A2-XAGO
YT37A2-XAGO