Human Generated Data

Title

Taso and Gus Stavrakis
Date

1992
People

Artist: Elsa Dorfman, American 1937 - 2020
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist in honor of Thomas Lee and Barbara Lee, P1994.15
Copyright

© Elsa Dorfman

Human Generated Data

Title

Taso and Gus Stavrakis

People

Artist: Elsa Dorfman, American 1937 - 2020

Date

1992

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.2
Person 99.2
Clothing 99.1
Hat 99.1
Apparel 99.1
Person 98.4
Chair 97.3
Furniture 97.3
Sitting 89.6
Pants 86.1
Wood 83.2
Face 74.4
Footwear 66.8
Shoe 66.8
Portrait 63.1
Photography 63.1
Photo 63.1
Finger 60.6
Jeans 59.8
Denim 59.8
Floor 59.3
Flooring 59.3

Imagga
created on 2022-02-26

person 35.4
child 30.9
adult 27.3
male 24.3
people 23.4
happy 23.2
man 22.2
home 21.5
smiling 19.5
innocent 19.1
portrait 18.8
face 17.8
fun 17.2
happiness 16.5
smile 16.4
clothing 16.1
lifestyle 15.9
casual 15.3
blond 15.1
family 15.1
indoors 14.9
childhood 14.3
shirt 14.1
senior 14.1
attractive 14
school 14
cheerful 13.8
hair 13.5
kid 13.3
boy 13
sitting 12.9
performer 12.5
pretty 11.9
comedian 11.6
cute 11.5
laughing 11.3
couple 11.3
human 11.2
life 11.1
expression 11.1
youth 11.1
little 10.6
elderly 10.5
one 10.5
looking 10.4
education 10.4
interior 9.7
room 9.5
love 9.5
mature 9.3
emotion 9.2
joy 9.2
business 9.1
holding 9.1
entertainer 8.9
lady 8.9
handsome 8.9
posing 8.9
together 8.8
retired 8.7
women 8.7
standing 8.7
30s 8.7
play 8.6
eyes 8.6
two 8.5
black 8.4
camera 8.4
hand 8.4
leisure 8.3
20s 8.2
professional 8.2
indoor 8.2
dress 8.1
group 8.1
mother 8
businessman 7.9
son 7.9
work 7.8
model 7.8
daughter 7.8
device 7.7
teacher 7.7
husband 7.6
wife 7.6
student 7.6
sit 7.6
fashion 7.5
world 7.5
guy 7.5
teen 7.4
playing 7.3
girls 7.3
office 7.2

Google
created on 2022-02-26

Smile 95.1
Sleeve 87.2
Hat 82
Picture frame 82
Chair 77.5
Vintage clothing 71.4
Art 68.2
Photo caption 66.3
Boot 66.1
Sun hat 64.9
Rectangle 64.4
Stock photography 62.2
Sitting 61
Cap 59.6
Toddler 59.5
Child 58.5
Retro style 54.8
Photographic paper 53.9
Baby 53.8
Advertising 52.3

Microsoft
created on 2022-02-26

text 99.5
clothing 98.6
person 98.4
human face 98.4
smile 98.3
wall 97.3
indoor 89.4
furniture 78.5
chair 60.9
man 50.8
picture frame 18.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Happy 75.6%
Surprised 14.4%
Fear 3.5%
Confused 2.1%
Disgusted 1.5%
Sad 1.1%
Angry 1%
Calm 0.8%

AWS Rekognition

Age 0-6
Gender Male, 95%
Happy 99.8%
Surprised 0.1%
Fear 0.1%
Sad 0%
Angry 0%
Confused 0%
Disgusted 0%
Calm 0%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Hat 99.1%
Shoe 66.8%

Captions

Microsoft

a boy sitting in a chair 45.1%
a boy sitting at a table 29.5%

Text analysis

Amazon

Taso
and
Apple
1993
Big
Cus
Big Apple Circus
Circus
FUN
Taso and Cus Sterrakie and FUN
Spring
Spring Sabmar 1993
Sterrakie
Sabmar

Google

fUN
and
Taso
Taso and Cus Sterakis and fUN atuan
atuan
Cus
Sterakis