Human Generated Data

Title

"Heaven on Earth," Uniondale

Date

1978

People

Artist: Sharon Smith, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.1730

Human Generated Data

Title

"Heaven on Earth," Uniondale

People

Artist: Sharon Smith, American 20th century

Date

1978

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.1730

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Audience 99.5
Crowd 99.5
Human 99.5
Person 99.3
Person 98.9
Person 97.5
Person 96.7
Person 93.6
Face 93.2
Person 93.1
Person 92.1
Person 89.9
Person 86.3
Person 85.9
Person 85.5
Collage 83.9
Advertisement 83.9
Poster 83.9
Person 82.5
Photo Booth 81.7
Head 80.8
Person 78.6
Person 76.8
Person 64.1
Person 63.3
Person 60.7
Interior Design 59.6
Indoors 59.6
Person 56.6
Hair 55.8

Clarifai
created on 2023-10-29

people 99.9
group 99.6
adult 98.6
woman 98.4
man 98.3
portrait 96.6
many 95.1
group together 94.1
audience 91.4
crowd 90.8
music 90.7
child 88.9
collage 88
facial expression 84.4
party 83.8
wear 83.8
adolescent 81.5
musician 76.8
retro 76.7
boy 76.7

Imagga
created on 2022-03-12

people 36.8
man 33.9
male 32.7
couple 32.2
happy 31.3
adult 30.5
happiness 29.8
smiling 29.7
spectator 29
kin 28.8
love 27.6
group 26.6
smile 26.4
together 26.3
attractive 25.9
women 23.7
portrait 22.7
person 21.8
casual 21.2
lifestyle 19.5
girlfriend 19.3
boyfriend 18.3
relationship 17.8
sexy 17.7
pretty 17.5
fun 17.2
cheerful 17.1
family 16.9
two 16.1
business 15.8
success 15.3
romance 15.2
suit 14.7
cute 14.4
team 14.3
romantic 14.3
face 14.2
togetherness 14.2
indoors 14.1
husband 14
youth 13.6
hug 13.6
groom 13.4
child 13.3
friends 13.2
teamwork 13
office 12.9
looking 12.8
joy 12.5
handsome 12.5
businessman 12.4
passion 12.2
lady 12.2
studio 12.2
corporate 12
men 12
businesswoman 11.8
boy 11.4
fashion 11.3
confident 10.9
valentine 10.9
holding 10.7
dating 10.7
diversity 10.6
black 10.4
wife 10.4
home 10.4
20s 10.1
sensual 10
colleagues 9.7
standing 9.6
ethnic 9.5
sitting 9.4
work 9.4
expression 9.4
friendship 9.4
executive 9.2
teen 9.2
girls 9.1
human 9
date 8.9
body 8.8
hugging 8.8
room 8.7
day 8.6
erotic 8.6
businesspeople 8.5
adults 8.5
hand 8.4
focus 8.3
successful 8.2
indoor 8.2
outdoors 8.2
teenager 8.2
laptop 8.2
brunette 7.8
professional 7.8
color 7.8
model 7.8
elegant 7.7
four 7.7
females 7.6
leisure 7.5
three 7.4
computer 7.2
entrepreneur 7.1
posing 7.1
night 7.1

Google
created on 2022-03-12

Gesture 85.3
Style 83.8
Art 80.8
Font 78.3
Happy 77.5
Collage 77.1
Crowd 75.2
Event 73.7
Visual arts 65.5
Vintage clothing 64.7
Room 64.2
Stock photography 64.2
Audience 63.7
Monochrome photography 58.4
Suit 54
Photo caption 53.7
Ceremony 53.6
Photographic paper 53
Fun 52.3
Portrait 51.9

Microsoft
created on 2022-03-12

human face 98.3
clothing 95.9
person 95.2
text 90.6
smile 89.8
woman 84.6
group 62.5
crowd 61.6
posing 41.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 99.7%
Happy 79.8%
Calm 8.2%
Angry 6.7%
Sad 1.7%
Confused 1.4%
Surprised 0.9%
Disgusted 0.8%
Fear 0.5%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Happy 34.3%
Sad 26.4%
Disgusted 14.6%
Angry 6.8%
Confused 6.8%
Calm 4.8%
Surprised 3.3%
Fear 3%

AWS Rekognition

Age 50-58
Gender Female, 99.9%
Sad 70.9%
Calm 18.5%
Angry 5%
Surprised 1.8%
Happy 1.2%
Fear 1%
Disgusted 0.8%
Confused 0.8%

AWS Rekognition

Age 51-59
Gender Female, 99.9%
Calm 65.9%
Sad 21.4%
Happy 5%
Confused 2.5%
Surprised 2%
Disgusted 1.5%
Angry 1%
Fear 0.7%

AWS Rekognition

Age 45-51
Gender Female, 100%
Calm 83.4%
Sad 6%
Confused 2.7%
Angry 2.1%
Disgusted 2%
Surprised 1.4%
Happy 1.3%
Fear 1%

AWS Rekognition

Age 29-39
Gender Male, 88%
Sad 27.4%
Fear 21.9%
Calm 12.1%
Surprised 11.5%
Confused 9.6%
Disgusted 8.3%
Angry 4.7%
Happy 4.6%

AWS Rekognition

Age 24-34
Gender Female, 98.7%
Sad 66.5%
Confused 13.7%
Calm 8.8%
Angry 6.2%
Disgusted 1.9%
Fear 1.1%
Surprised 1.1%
Happy 0.6%

AWS Rekognition

Age 24-34
Gender Female, 99.8%
Fear 80.2%
Calm 13%
Sad 4%
Happy 1.2%
Disgusted 0.5%
Angry 0.5%
Surprised 0.3%
Confused 0.3%

AWS Rekognition

Age 26-36
Gender Female, 99.9%
Sad 96.8%
Calm 1.8%
Angry 0.6%
Fear 0.4%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Female, 99.4%
Happy 92.6%
Calm 2.3%
Fear 1.5%
Angry 1.2%
Surprised 0.9%
Confused 0.6%
Disgusted 0.5%
Sad 0.4%

AWS Rekognition

Age 52-60
Gender Male, 90.1%
Calm 59.5%
Happy 13.4%
Confused 10.1%
Surprised 6.9%
Fear 3.1%
Angry 3%
Sad 2.3%
Disgusted 1.7%

AWS Rekognition

Age 43-51
Gender Female, 62%
Happy 80.3%
Sad 5.8%
Fear 5.5%
Calm 5.4%
Angry 0.9%
Surprised 0.8%
Confused 0.7%
Disgusted 0.7%

AWS Rekognition

Age 23-31
Gender Female, 78.8%
Calm 75.7%
Sad 6%
Happy 5.3%
Angry 4.4%
Surprised 3.5%
Confused 2.3%
Fear 1.8%
Disgusted 1%

AWS Rekognition

Age 31-41
Gender Female, 100%
Happy 75.7%
Sad 10.6%
Angry 4.3%
Disgusted 4.3%
Fear 3.2%
Confused 1.1%
Surprised 0.5%
Calm 0.3%

AWS Rekognition

Age 14-22
Gender Male, 99.4%
Calm 97.3%
Sad 1%
Disgusted 0.6%
Confused 0.4%
Surprised 0.2%
Angry 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 4-12
Gender Female, 99.9%
Happy 30.6%
Calm 23.1%
Angry 20.9%
Sad 19.5%
Fear 1.8%
Disgusted 1.7%
Surprised 1.7%
Confused 0.7%

AWS Rekognition

Age 22-30
Gender Male, 94.1%
Calm 45.1%
Fear 35.4%
Confused 9.4%
Angry 4.1%
Surprised 2.1%
Sad 2%
Disgusted 1.4%
Happy 0.6%

AWS Rekognition

Age 18-26
Gender Male, 62.6%
Happy 73.2%
Sad 14.5%
Calm 4.9%
Disgusted 2.3%
Fear 1.8%
Surprised 1.4%
Angry 1%
Confused 0.9%

AWS Rekognition

Age 23-33
Gender Female, 88.5%
Fear 48.9%
Calm 26.4%
Happy 11.6%
Surprised 4%
Confused 2.6%
Disgusted 2.4%
Angry 2.3%
Sad 1.9%

AWS Rekognition

Age 6-12
Gender Female, 99.1%
Sad 73.7%
Calm 13.5%
Happy 6.9%
Angry 2.6%
Confused 1.1%
Surprised 0.8%
Fear 0.7%
Disgusted 0.7%

AWS Rekognition

Age 9-17
Gender Male, 91%
Fear 38.5%
Sad 27.5%
Happy 18.5%
Calm 5.2%
Surprised 4.1%
Angry 3.6%
Disgusted 2%
Confused 0.7%

AWS Rekognition

Age 18-24
Gender Male, 78.2%
Calm 79.7%
Fear 14.2%
Confused 3.3%
Sad 1.1%
Surprised 0.6%
Angry 0.5%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 23-31
Gender Female, 79.7%
Calm 57.9%
Sad 18.9%
Angry 6.9%
Happy 5.1%
Confused 4.1%
Disgusted 3.3%
Fear 2%
Surprised 1.8%

AWS Rekognition

Age 29-39
Gender Male, 74.4%
Sad 92.8%
Angry 2.4%
Fear 2.2%
Calm 1.7%
Surprised 0.3%
Confused 0.3%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 6-14
Gender Female, 99.6%
Calm 96.5%
Happy 1%
Fear 0.9%
Angry 0.6%
Confused 0.4%
Sad 0.3%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 23-31
Gender Male, 87.4%
Calm 34.4%
Sad 21%
Angry 20.6%
Confused 7.5%
Surprised 5.8%
Fear 4.7%
Happy 3.7%
Disgusted 2.5%

AWS Rekognition

Age 16-22
Gender Female, 61%
Calm 98.5%
Surprised 0.8%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 97.8%
Happy 39%
Sad 22.5%
Confused 15.8%
Calm 11%
Disgusted 5.1%
Surprised 4.7%
Fear 1.1%
Angry 0.8%

AWS Rekognition

Age 10-18
Gender Male, 98%
Calm 45.6%
Angry 28.2%
Fear 11.3%
Sad 9.6%
Confused 1.8%
Happy 1.3%
Disgusted 1.2%
Surprised 1%

AWS Rekognition

Age 26-36
Gender Male, 99.2%
Calm 97.5%
Fear 2.3%
Disgusted 0.1%
Happy 0%
Angry 0%
Confused 0%
Sad 0%
Surprised 0%

AWS Rekognition

Age 16-22
Gender Female, 96.7%
Sad 36.1%
Confused 23.8%
Calm 17.8%
Disgusted 10%
Angry 4.6%
Fear 4%
Surprised 2.8%
Happy 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.3%
Person 98.9%
Person 97.5%
Person 96.7%
Person 93.6%
Person 93.1%
Person 92.1%
Person 89.9%
Person 86.3%
Person 85.9%
Person 85.5%
Person 82.5%
Person 78.6%
Person 76.8%
Person 64.1%
Person 63.3%
Person 60.7%
Person 56.6%

Categories

Imagga

paintings art 98.3%
pets animals 1.2%