Human Generated Data

Title

Untitled (portrait of grandparents with their children [?])

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2267

Human Generated Data

Title

Untitled (portrait of grandparents with their children [?])

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Clothing 99.8
Apparel 99.8
Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 99.4
Person 98.2
Person 97.5
Suit 97.2
Overcoat 97.2
Coat 97.2
Dress 94.3
Shirt 90.2
Face 89.7
Shorts 88.5
Female 88.4
Sleeve 85.8
Icing 83.1
Dessert 83.1
Food 83.1
Cream 83.1
Creme 83.1
Cake 83.1
Tuxedo 81.6
People 79.6
Chair 78
Furniture 78
Plant 75.3
Tie 75.2
Accessories 75.2
Accessory 75.2
Sailor Suit 73.8
Long Sleeve 72
Woman 71
Portrait 68.6
Photography 68.6
Photo 68.6
Sunglasses 67.8
Flower 64.3
Blossom 64.3
Girl 64.1
Indoors 61.9
Steamer 61.8
Man 60.1
Pottery 57.7
Jar 57.7
Vase 57.7
Potted Plant 57.7
Head 57.2

Imagga
created on 2022-01-30

person 40.2
man 37.6
people 36.2
senior 31.8
male 31.2
adult 27.6
kin 26.3
nurse 26.2
elderly 23.9
happy 23.2
businessman 22.9
group 22.5
business 22.4
golfer 20.8
men 20.6
patient 20.2
couple 19.1
team 18.8
indoors 18.4
together 18.4
old 18.1
smiling 18.1
mature 17.6
camera 16.6
portrait 16.2
player 16.1
teamwork 15.7
sitting 15.4
businesspeople 15.2
professional 14.9
teacher 14.8
colleagues 14.6
30s 14.4
casual 14.4
meeting 14.1
office 13.6
looking 13.6
retired 13.6
home 13.5
medical 13.2
health 13.2
room 13.1
case 12.9
contestant 12.6
job 12.4
lifestyle 12.3
desk 12.3
cheerful 12.2
women 11.9
businesswoman 11.8
60s 11.7
worker 11.6
grandfather 11.6
retirement 11.5
brass 11.4
sibling 11.2
sick person 11.1
work 11
indoor 10.9
70s 10.8
older 10.7
busy 10.6
hospital 10.5
human 10.5
friends 10.3
friendship 10.3
holding 9.9
care 9.9
student 9.7
four 9.6
executive 9.6
standing 9.6
husband 9.5
day 9.4
doctor 9.4
smile 9.3
occupation 9.2
20s 9.2
family 8.9
to 8.8
success 8.8
coworkers 8.8
medicine 8.8
half length 8.8
40s 8.8
mid adult 8.7
love 8.7
education 8.6
married 8.6
happiness 8.6
corporate 8.6
talking 8.5
face 8.5
specialist 8.5
wind instrument 8.3
successful 8.2
clothing 8.2
aged 8.1
handsome 8
working 7.9
associates 7.9
table 7.8
thirties 7.8
cooperation 7.7
child 7.6
two 7.6
age 7.6
hand 7.6
enjoying 7.6
communication 7.5
horizontal 7.5
drink 7.5
educator 7.4
inside 7.4
active 7.3
world 7.1

Google
created on 2022-01-30

Microsoft
created on 2022-01-30

text 96.5
person 96.3
smile 90.2
posing 82.3
clothing 79.2
ceremony 68.1
wedding 63.3
man 56.7
drawing 53.4
old 41.8

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 99%
Happy 97.8%
Surprised 1%
Confused 0.4%
Calm 0.2%
Disgusted 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Male, 78.4%
Surprised 83.6%
Happy 5.8%
Sad 3.9%
Calm 2.3%
Confused 1.9%
Disgusted 1.6%
Fear 0.6%
Angry 0.3%

AWS Rekognition

Age 48-56
Gender Male, 99.4%
Happy 77.3%
Surprised 7.8%
Confused 6.8%
Calm 3.9%
Disgusted 2.3%
Sad 0.7%
Fear 0.6%
Angry 0.6%

AWS Rekognition

Age 43-51
Gender Female, 93%
Calm 86.4%
Happy 9.7%
Surprised 1.5%
Angry 0.8%
Disgusted 0.6%
Confused 0.5%
Fear 0.4%
Sad 0.2%

AWS Rekognition

Age 53-61
Gender Male, 99.9%
Happy 95.3%
Confused 1%
Surprised 0.9%
Calm 0.8%
Disgusted 0.6%
Sad 0.5%
Fear 0.5%
Angry 0.4%

AWS Rekognition

Age 49-57
Gender Female, 94.6%
Happy 91.6%
Calm 3.4%
Surprised 2.2%
Sad 1%
Disgusted 0.6%
Confused 0.5%
Angry 0.4%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 75.2%
Sunglasses 67.8%

Captions

Microsoft

a group of people posing for a photo 97.5%
a group of people posing for the camera 97.4%
a group of people posing for a picture 97.3%

Text analysis

Amazon

KODAK-