Human Generated Data

Title

Untitled (family portrait with five generations)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2275

Human Generated Data

Title

Untitled (family portrait with five generations)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Tie 97.9
Accessories 97.9
Accessory 97.9
Person 96.9
Human 96.9
Person 96.7
Person 96.2
Clothing 95.6
Apparel 95.6
Tie 93.8
Person 92.3
Tie 91.2
Person 89.3
Suit 87.9
Coat 87.9
Overcoat 87.9
Furniture 81.8
Suit 78
Chair 73.4
People 70.6
Clinic 66.7
Flower 61.2
Plant 61.2
Blossom 61.2
Photo 60.5
Photography 60.5
Sitting 57.4

Imagga
created on 2022-01-30

nurse 61.1
man 40.3
people 37.4
male 36.9
senior 36.6
kin 36.4
person 31.6
couple 29.6
elderly 26.8
medical 26.5
adult 26.3
mature 26
happy 25.7
men 24.9
smiling 24.6
patient 24.4
hospital 24.1
doctor 23.5
professional 21.1
indoors 21.1
portrait 20.7
grandma 19.2
health 18.8
home 18.4
groom 17.6
care 17.3
women 16.6
happiness 16.5
team 16.1
old 16
family 16
occupation 15.6
looking 15.2
business 15.2
specialist 15.2
businessman 15
sitting 14.6
husband 14.3
job 14.2
together 14
coat 13.9
worker 13.7
clinic 13.6
two 13.5
30s 13.5
illness 13.3
wife 13.3
stethoscope 13.1
camera 12.9
retired 12.6
retirement 12.5
businesspeople 12.3
medicine 12.3
lifestyle 12.3
cheerful 12.2
smile 12.1
clothing 12.1
grandfather 11.8
married 11.5
lab coat 11.5
talking 11.4
standing 11.3
group 11.3
office 11.2
love 11
inside 11
day 11
room 10.9
70s 10.8
40s 10.7
two people 10.7
colleagues 10.7
older 10.7
sick 10.6
working 10.6
teamwork 10.2
aged 10
suit 9.9
bride 9.8
caring 9.8
human 9.7
profession 9.6
casual 9.3
joy 9.2
20s 9.2
indoor 9.1
businesswoman 9.1
forties 8.8
50s 8.8
60s 8.8
physician 8.8
look 8.8
middle aged 8.8
examination 8.7
work 8.6
corporate 8.6
meeting 8.5
mother 8.4
wedding 8.3
handsome 8
fifties 7.9
doctors 7.9
face 7.8
color 7.8
thirties 7.8
mid adult 7.7
laboratory 7.7
modern 7.7
drinking 7.7
staff 7.6
help 7.5
pensioner 7.4
confident 7.3

Google
created on 2022-01-30

Coat 89.3
Hat 87.7
Style 83.8
Suit 81.9
Vintage clothing 73.8
Smile 73.5
Event 73.5
Monochrome 72.7
Monochrome photography 72.2
Formal wear 71.9
Tie 71.6
Classic 70.7
Stock photography 65.1
History 64.1
White-collar worker 62.3
Window 61.9
Uniform 60.9
Sitting 59.1
Retro style 54.4
Family 54.1

Microsoft
created on 2022-01-30

wall 98
person 97.4
smile 93.9
clothing 88.7
posing 77.2
man 70.1
white 62.7
wedding 61.2
wedding dress 57.9
human face 53.1
old 49.6

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Female, 91.3%
Calm 59%
Sad 33.2%
Happy 4.1%
Fear 1.2%
Confused 0.8%
Disgusted 0.7%
Angry 0.6%
Surprised 0.4%

AWS Rekognition

Age 39-47
Gender Female, 69.2%
Confused 34.5%
Calm 23.3%
Sad 12.3%
Happy 11.5%
Disgusted 7.8%
Surprised 5.2%
Angry 3.7%
Fear 1.8%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Calm 53.5%
Surprised 16.5%
Happy 10.1%
Disgusted 8.9%
Sad 6.4%
Confused 3%
Angry 0.9%
Fear 0.7%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Happy 98.8%
Surprised 0.6%
Calm 0.2%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 53-61
Gender Male, 99.7%
Sad 97.4%
Happy 1.3%
Fear 0.6%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%
Calm 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 97.9%
Person 96.9%
Suit 87.9%

Captions

Microsoft

a group of people posing for a photo with Lincoln Memorial in the background 95.7%
a group of people posing for the camera with Lincoln Memorial in the background 95.6%
a group of people posing for a picture with Lincoln Memorial in the background 95.5%

Text analysis

Google

--
2oVEEIA---ETFW
RODVR
RODVR -- 2oVEEIA---ETFW