Human Generated Data

Title

Untitled (portrait of grandparents with their children [?])
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2266

Human Generated Data

Title

Untitled (portrait of grandparents with their children [?])

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Apparel 99.7
Clothing 99.7
Human 99.7
Person 99.7
Person 99.6
Person 99.4
Person 99.4
Person 98.1
Person 98
Sleeve 90.7
Shorts 89.6
Face 89.2
Shirt 88.3
Overcoat 83.7
Suit 83.7
Coat 83.7
Female 77.3
Long Sleeve 74.8
People 70.8
Portrait 65.9
Photography 65.9
Photo 65.9
Furniture 63.6
Dress 59.2
Sailor Suit 58.9
Accessory 58.8
Tie 58.8
Accessories 58.8
Girl 58.5
Woman 57.8
Tuxedo 55.4
Tie 50.4

Imagga
created on 2022-01-30

man 37.6
person 37.2
senior 36.5
male 36.1
people 34
adult 30.6
elderly 27.7
businessman 24.7
business 24.3
golfer 24.2
happy 23.8
couple 23.5
men 21.5
mature 21.4
indoors 21.1
professional 20.3
group 20.1
old 19.5
player 18.7
patient 18.7
teacher 17.8
kin 17.5
smiling 17.4
sitting 17.2
businesspeople 17.1
job 16.8
home 16.7
executive 16.7
together 16.6
camera 16.6
portrait 16.2
team 16.1
casual 16.1
looking 15.2
contestant 14.7
colleagues 14.6
meeting 14.1
medical 14.1
nurse 14
cheerful 13.8
60s 13.7
office 13.6
older 13.6
30s 13.5
women 13.4
day 13.3
teamwork 13
retired 12.6
health 12.5
lifestyle 12.3
case 12.1
occupation 11.9
20s 11.9
70s 11.8
happiness 11.7
doctor 11.3
work 11
indoor 10.9
40s 10.7
care 10.7
educator 10.6
retirement 10.6
hospital 10.3
grandfather 10.3
room 10.2
smile 10
aged 9.9
worker 9.9
secretary 9.8
human 9.7
half length 9.7
working 9.7
four 9.6
standing 9.6
corporate 9.4
friends 9.4
friendship 9.4
face 9.2
horizontal 9.2
inside 9.2
businesswoman 9.1
clothing 8.9
family 8.9
gray hair 8.9
specialist 8.9
to 8.8
coworkers 8.8
mid adult 8.7
busy 8.7
profession 8.6
student 8.6
illness 8.6
enjoying 8.5
two 8.5
company 8.4
drink 8.3
brass 8.3
active 8.3
holding 8.2
sick person 8.2
love 7.9
facing camera 7.9
associates 7.9
seniors 7.8
casual clothing 7.8
middle aged 7.8
thirties 7.8
stethoscope 7.7
married 7.7
clinic 7.7
husband 7.6
talking 7.6
desk 7.6
technology 7.4
building 7.1
handsome 7.1
life 7.1
medicine 7

Google
created on 2022-01-30

Photograph 94.2
Black 89.6
Sleeve 87.2
Coat 86
Black-and-white 85.5
Style 84
Monochrome photography 75.6
Monochrome 74.9
Snapshot 74.3
Blazer 73.1
Event 72.9
Vintage clothing 72.5
Formal wear 71.2
Classic 71
Fashion design 70.8
Pattern 70.5
Room 66.3
Suit 66.3
Stock photography 65
Font 64.2

Microsoft
created on 2022-01-30

text 97
person 96
smile 90.8
posing 83.3
clothing 81.4
man 61

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 97%
Surprised 54.9%
Happy 34.2%
Confused 4.4%
Disgusted 2.5%
Sad 2%
Calm 1%
Fear 0.6%
Angry 0.3%

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Happy 59.3%
Calm 19.9%
Sad 5.2%
Surprised 5%
Confused 4.5%
Disgusted 2.4%
Fear 1.8%
Angry 1.8%

AWS Rekognition

Age 48-56
Gender Female, 68.6%
Happy 96.4%
Surprised 1.5%
Calm 0.6%
Sad 0.5%
Disgusted 0.4%
Angry 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Happy 94.7%
Surprised 1.4%
Calm 1.4%
Confused 1%
Disgusted 0.8%
Fear 0.2%
Sad 0.2%
Angry 0.2%

AWS Rekognition

Age 50-58
Gender Male, 99.7%
Happy 86.8%
Surprised 11.1%
Confused 1.1%
Disgusted 0.2%
Angry 0.2%
Sad 0.2%
Calm 0.2%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Female, 72.6%
Happy 52.1%
Calm 40.6%
Surprised 3.8%
Angry 1.1%
Disgusted 1%
Confused 0.6%
Fear 0.5%
Sad 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 58.8%

Captions

Microsoft

a group of people posing for a photo 96.8%
a group of people posing for the camera 96.7%
a group of people posing for a picture 96.6%

Text analysis

Amazon

KODAKCO