Human Generated Data

Title

Becky and Ian, Newton Center, Maine
Date

1980
People

Artist: Charles Melcher, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1429

Human Generated Data

Title

Becky and Ian, Newton Center, Maine

People

Artist: Charles Melcher, American 20th century

Date

1980

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.8
Human 99.8
Person 99.5
Clothing 85.5
Apparel 85.5
Meal 67.4
Food 67.4
Finger 65.1
Plant 61.6
Kid 58.9
Child 58.9
Furniture 57

Imagga
created on 2022-01-22

child 36.7
people 28.4
person 24.5
male 24.1
happy 23.8
cute 23.7
boy 22.6
kid 22.1
family 19.6
man 19.5
portrait 19.4
adult 18.8
face 17.7
happiness 17.2
fun 17.2
childhood 17
smiling 16.6
youth 15.3
little 15
brother 14.3
women 14.2
joy 14.2
children 13.7
parent 13.4
play 12.9
adorable 12.9
love 12.6
black 12.6
attractive 12.6
couple 12.2
smile 12.1
human 12
mother 11.9
hair 11.9
casual 11.9
two 11.9
lifestyle 11.6
together 11.4
father 11.4
baby 11.4
playing 10.9
leisure 10.8
enjoying 10.4
education 10.4
school 10.1
looking 9.6
men 9.4
park 9.4
son 9.3
holding 9.1
fashion 9
outdoors 9
home 8.8
sitting 8.6
outside 8.6
pretty 8.4
photographer 8.2
cheerful 8.1
daughter 8
dad 7.9
blond 7.8
toddler 7.6
friends 7.5
one 7.5
care 7.4
device 7.3
handsome 7.1
work 7.1
working 7.1
day 7.1

Google
created on 2022-01-22

Hairstyle 95.1
Black-and-white 85.9
Style 83.9
Adaptation 79.3
Monochrome 76.7
Monochrome photography 75.6
Child 73.2
Art 71.9
Plant 67.1
Room 66.9
Vintage clothing 66
Eyewear 65.1
Hat 65.1
Stock photography 64
Sitting 63.2
Photo caption 56.9
Illustration 53.9
Reading 52.8
Camera 52.2
Visual arts 51.9

Microsoft
created on 2022-01-22

person 99.8
outdoor 98.7
text 98.6
black and white 97.3
clothing 93.8
toddler 86.8
human face 85.3
monochrome 79.5
baby 75
boy 73.4
street 62.3
crowd 1.3

Face analysis

Amazon

Google

AWS Rekognition

Age 1-7
Gender Female, 92.8%
Confused 56%
Sad 36.1%
Angry 2.7%
Calm 2.5%
Disgusted 1.1%
Fear 0.8%
Surprised 0.5%
Happy 0.4%

AWS Rekognition

Age 0-6
Gender Female, 94.6%
Sad 96.6%
Calm 1.2%
Angry 0.7%
Fear 0.7%
Confused 0.4%
Disgusted 0.2%
Happy 0.1%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people sitting on a bench 81.3%
a group of people sitting around each other 81.2%
a group of people sitting at a bench 80.9%