Human Generated Data

Title

Stephanie Zilonis. Annette McCollin. Ericka Ribeiro. Lisa Milligan. Tiffany Pan.
Date

July 17, 1998
People

Artist: Elsa Dorfman, American 1937 - 2020
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, P2001.25
Copyright

© Elsa Dorfman

Human Generated Data

Title

Stephanie Zilonis. Annette McCollin. Ericka Ribeiro. Lisa Milligan. Tiffany Pan.

People

Artist: Elsa Dorfman, American 1937 - 2020

Date

July 17, 1998

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 100
Apparel 100
Shorts 100
Person 99.9
Human 99.9
Person 99.8
Person 99.8
Person 99.8
Person 99.6
Pants 99.6
Footwear 98.3
Shoe 98.3
Shoe 97.3
Shoe 97.1
Shoe 96.9
Shoe 96.8
Shoe 96.5
Denim 94
Shoe 94
Shoe 93.5
Jeans 90.6
Shoe 87.9
Sleeve 86.4
T-Shirt 81
Shoe 71.8
Boy 56.6

Imagga
created on 2022-02-26

people 41.3
smiling 38.4
happy 38.2
group 37.9
person 34
smile 31.4
child 29.2
man 28.9
male 27.5
friends 27.3
women 26.1
family 25.8
together 25.4
boy 25.2
school 23.5
adult 22.9
casual 22.9
student 22.3
standing 20.9
buddy 20.8
students 20.5
portrait 20.1
couple 19.2
girls 19.1
friendship 18.7
mother 18.7
diversity 18.3
education 18.2
men 18
lifestyle 17.4
fun 17.2
father 17
home 16.8
cute 16.5
happiness 16.5
children 16.4
indoors 15.8
diverse 15.7
cheerful 15.4
team 15.2
looking 15.2
holding 14.9
kid 14.2
daughter 14
teen 13.8
teenager 13.7
youth 13.6
son 12.5
classroom 12.2
life 12.2
room 12.1
teacher 12.1
teamwork 12.1
20s 11.9
attractive 11.9
pretty 11.9
golfer 11.7
full length 11.6
sitting 11.2
camera 11.1
professional 11.1
love 11
two 11
handsome 10.7
30s 10.6
parent 10.6
husband 10.5
doctor 10.3
sibling 10
childhood 9.9
teenagers 9.7
moving 9.5
females 9.5
kids 9.4
hospital 9.1
player 9
nurse 9
interior 8.9
dad 8.7
teenage 8.6
laughing 8.5
business 8.5
togetherness 8.5
learning 8.5
color 8.3
friendly 8.2
confident 8.2
staff 8.1
backpack 8.1
uniform 8
medical 7.9
building 7.9
work 7.9
thirties 7.8
boys 7.8
looking camera 7.7
clothing 7.7
four 7.7
sofa 7.7
university 7.7
jeans 7.6
college 7.6
walking 7.6
adults 7.6
house 7.5
study 7.5
three 7.4
brother 7.4
indoor 7.3
new 7.3
businesswoman 7.3
computer 7.2
blond 7.2
contestant 7.1
businessman 7.1
medicine 7

Google
created on 2022-02-26

Footwear 98.1
Shorts 97.7
Shoe 94.7
Sleeve 87.2
Standing 86.4
T-shirt 80.7
Font 79.2
Happy 78.1
Handwriting 76.9
Leisure 75.7
Friendship 74.1
Boot 73.6
Event 72.9
Thigh 71.2
Fun 71
Art 70.8
Team 68.2
Fashion design 68.1
Child 63.3
Denim 63.2

Microsoft
created on 2022-02-26

boy 99.4
clothing 98.3
text 97.8
wall 97.1
smile 96.9
person 95.1
human face 94.1
footwear 90.9
indoor 86.5
shorts 79.1
posing 71.1
toddler 69.4
group 66.4
family 64.4

Face analysis

Amazon

Google

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 99.3%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%
Calm 0%
Sad 0%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 65.9%
Confused 22.1%
Happy 5.5%
Sad 1.8%
Angry 1.4%
Fear 1.4%
Disgusted 1%
Surprised 0.8%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 45.8%
Happy 45.5%
Surprised 3.4%
Angry 2.4%
Confused 1.5%
Disgusted 0.7%
Sad 0.4%
Fear 0.3%

AWS Rekognition

Age 9-17
Gender Female, 99.9%
Calm 77%
Happy 9.9%
Confused 7.8%
Surprised 3.7%
Angry 0.8%
Disgusted 0.4%
Fear 0.2%
Sad 0.2%

AWS Rekognition

Age 6-14
Gender Female, 69.3%
Calm 97.6%
Confused 1.5%
Surprised 0.4%
Angry 0.2%
Sad 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Shoe 98.3%
Jeans 90.6%

Captions

Microsoft

Sita Thomas et al. posing for a photo 97.3%
Sita Thomas et al. posing for the camera 97.2%
Sita Thomas et al. posing for a picture 97.1%

Text analysis

Amazon

July
17,
Ericka
17, 1998.
William
Amette
1998.
Jina
Stephens Jilonis Amette Infollin July Ericka fibeiro. Jina William The
Jilonis
Antman
Stephens
fibeiro.
Infollin
The
Swatt!

Google

lonis; Tuly 17,1919.
lonis;
17,1919.
Tuly