Human Generated Data

Title

Utica, Ohio

Date

1983

People

Artist: Sheron Rupp, American born 1943

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, P1984.18

Human Generated Data

Title

Utica, Ohio

People

Artist: Sheron Rupp, American born 1943

Date

1983

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.7
Person 99.7
Person 99.6
Person 99.5
Person 99.2
Person 98.6
Person 98.3
Person 98.1
Clothing 93.3
Apparel 93.3
Footwear 87.7
Shoe 87.7
Pants 87
Couch 82.9
Furniture 82.9
Shorts 79.2
Flooring 76.3
Wood 74.6
Jeans 67.6
Denim 67.6
Plywood 65.5
Porch 64.8
Girl 63.9
Female 63.9
Hair 60
Kid 59.8
Child 59.8
Kindergarten 57.4

Imagga
created on 2022-02-26

child 74.1
family 48.1
happy 44.5
smiling 43.4
together 43
mother 42.9
children 39.2
people 36.3
boy 35.7
group 35.5
father 34.2
male 33.2
man 30.3
person 29.6
kid 29.3
home 27.9
fun 27.7
daughter 27.7
smile 26.4
love 26.1
portrait 24.6
happiness 24.3
sitting 24.1
son 23.7
kids 23.6
childhood 22.4
adult 22.1
friends 20.7
lifestyle 20.3
parent 20.2
kin 20.1
classroom 20
sibling 19.7
school 19.7
indoors 19.3
husband 19.1
couple 18.3
mature 17.7
mom 17.5
girls 17.3
cheerful 17.1
brother 17
women 16.6
playing 16.4
youth 16.2
casual 16.1
dad 15.7
parents 15.7
sister 15.6
education 15.6
boys 15.5
30s 15.4
outdoors 14.9
joy 14.2
little 14.1
cute 13.6
wife 13.3
togetherness 13.2
teacher 13.2
room 13.1
senior 13.1
men 12.9
teenager 12.8
four 12.5
laughing 12.3
life 12.1
camera 12
teen 12
enjoying 11.4
two 11
horizontal 10.9
grandmother 10.8
hospital 10.6
loving 10.5
study 10.3
house 10
park 10
families 9.8
lesson 9.8
grandfather 9.7
thirties 9.7
juvenile 9.6
looking 9.6
studying 9.6
laugh 9.6
standing 9.6
day 9.4
outside 9.4
buddy 9.4
baby 9.4
indoor 9.1
team 9
interior 8.8
mum 8.8
students 8.8
hug 8.7
generation 8.6
play 8.6
face 8.5
companion 8.5
learning 8.5
friendship 8.4
student 8.4
to 8
classmate 7.9
brothers 7.9
elementary 7.8
40s 7.8
innocent 7.8
couch 7.7
class 7.7
pretty 7.7
attractive 7.7
sofa 7.7
living 7.6
three 7.5
book 7.3
relaxing 7.3
handsome 7.1

Google
created on 2022-02-26

Clothing 98.7
Shorts 95.2
Human 89.8
Fashion 88.4
Sleeve 87.2
Standing 86.4
Happy 86.2
Fun 83.7
Window 83.1
T-shirt 81.4
Community 80.9
Toddler 80.8
Adaptation 79.4
Summer 78.2
Leisure 77.2
Beauty 75.3
Friendship 74.2
Event 71.9
Child 71.9
Travel 71.9

Microsoft
created on 2022-02-26

person 100
toddler 98.8
clothing 98.2
human face 97.9
boy 95.5
smile 95.3
baby 94.1
girl 90.4
child 84.4
family 74.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-10
Gender Female, 100%
Sad 47.6%
Calm 23.5%
Confused 17.3%
Fear 4.3%
Disgusted 4.3%
Surprised 1.3%
Happy 1.1%
Angry 0.6%

AWS Rekognition

Age 4-12
Gender Male, 92.4%
Sad 36.7%
Calm 19%
Confused 17.7%
Fear 7.7%
Surprised 7.3%
Disgusted 4.9%
Angry 3.4%
Happy 3.3%

AWS Rekognition

Age 6-14
Gender Female, 89.8%
Sad 51.2%
Calm 47%
Fear 0.4%
Confused 0.4%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 10-18
Gender Male, 68.3%
Sad 53.1%
Calm 28.7%
Happy 15.4%
Disgusted 0.8%
Confused 0.7%
Fear 0.6%
Angry 0.4%
Surprised 0.4%

AWS Rekognition

Age 1-7
Gender Female, 63%
Confused 43.3%
Happy 18.3%
Calm 10.7%
Fear 10%
Angry 9.7%
Sad 4.5%
Surprised 2.2%
Disgusted 1.4%

AWS Rekognition

Age 7-17
Gender Male, 100%
Happy 99.5%
Sad 0.2%
Fear 0.1%
Surprised 0.1%
Calm 0.1%
Angry 0%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 87.7%

Captions

Microsoft

a group of young children standing next to a window 67.6%
a group of young children standing in front of a building 67.5%
a group of young children standing next to a building 67.4%

Text analysis

Amazon

UTIC

Google

UTIC
UTIC