Human Generated Data

Title

Untitled (man dressed as Santa Claus surrounded by children on grass)

Date

1949

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5036

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man dressed as Santa Claus surrounded by children on grass)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.3
Human 99.3
Person 99.1
Person 99
Person 98.7
Person 98
Person 97.6
Apparel 97.4
Clothing 97.4
Person 97.3
Person 97
Person 97
People 96.3
Person 93.4
Shorts 93
Person 83.4
Person 81.1
Person 78.9
Crowd 68.6
Girl 61
Female 61
Kid 58.5
Child 58.5
Outdoors 58.5
Picnic 58.2
Food 58.2
Vacation 58.2
Leisure Activities 58.2
Meal 58.2
Family 56.9
Person 52.1
Person 51.2
Person 49

Imagga
created on 2022-01-22

negative 36.2
film 30.4
people 23.4
photographic paper 22
art 19.7
person 18.6
man 16.8
dance 16
male 15.6
adult 15
kin 14.9
photographic equipment 14.7
men 13.7
creation 13.5
love 13.4
silhouette 12.4
couple 12.2
sport 12.1
summer 11.6
happy 11.3
old 11.1
happiness 10.2
lifestyle 10.1
joy 10
active 9.9
fun 9.7
black 9.6
sky 9.6
women 9.5
smiling 9.4
fashion 9
dress 9
history 8.9
bride 8.8
standing 8.7
statue 8.6
smile 8.5
two 8.5
travel 8.4
outdoor 8.4
portrait 8.4
human 8.2
newspaper 8.1
light 8.1
sexy 8
body 8
ancient 7.8
attractive 7.7
married 7.7
beach 7.6
daily 7.5
groom 7.5
leisure 7.5
outdoors 7.5
action 7.4
park 7.4
wedding 7.4
life 7.3
exercise 7.3
group 7.2
family 7.1
face 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 99.6
grass 97.9
person 95.9
clothing 95.2
outdoor 95
player 91.3
posing 86.4
woman 76.2
standing 75.3
wedding dress 71.3
old 69.4
bride 64.2
team 62.2
group 60.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 96.3%
Calm 40.5%
Sad 24%
Angry 13.2%
Happy 12.6%
Disgusted 3%
Surprised 2.8%
Confused 2.7%
Fear 1.3%

AWS Rekognition

Age 51-59
Gender Female, 50.7%
Calm 99.3%
Sad 0.2%
Confused 0.2%
Happy 0.1%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 4-12
Gender Male, 89%
Calm 97.7%
Sad 1.4%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Happy 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 95.9%
Sad 53.3%
Calm 41.7%
Disgusted 2.3%
Surprised 1%
Angry 0.7%
Confused 0.6%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 59.4%
Calm 54.1%
Sad 28.9%
Surprised 8.7%
Fear 2.2%
Angry 1.9%
Happy 1.7%
Confused 1.4%
Disgusted 1.1%

AWS Rekognition

Age 26-36
Gender Female, 99.9%
Calm 74.9%
Sad 10.7%
Surprised 5.8%
Angry 2.7%
Confused 2.2%
Happy 1.6%
Disgusted 1.1%
Fear 1%

AWS Rekognition

Age 22-30
Gender Male, 78.3%
Happy 92.7%
Calm 3.8%
Sad 0.8%
Angry 0.8%
Confused 0.7%
Surprised 0.5%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Female, 57.3%
Calm 97.3%
Sad 1.8%
Fear 0.4%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 23-31
Gender Female, 92.9%
Happy 99.4%
Sad 0.2%
Calm 0.2%
Surprised 0.1%
Fear 0.1%
Angry 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 41-49
Gender Male, 94.8%
Calm 93.3%
Sad 4.5%
Confused 0.9%
Surprised 0.4%
Happy 0.2%
Disgusted 0.2%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 37-45
Gender Male, 81.2%
Sad 81.2%
Calm 13.1%
Happy 3.8%
Confused 0.6%
Fear 0.4%
Angry 0.4%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Female, 89.4%
Calm 74.4%
Sad 22.1%
Happy 1.8%
Confused 0.7%
Angry 0.4%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Female, 63.3%
Sad 81%
Happy 13.5%
Disgusted 1.8%
Angry 0.9%
Calm 0.9%
Confused 0.8%
Surprised 0.6%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of baseball players posing for a photo 79.4%
a vintage photo of a group of people posing for the camera 79.3%
a vintage photo of a group of people posing for a picture 79.2%

Text analysis

Amazon

FLORIDA
STEINMETZ,
STEINMETZ, SARASOTA, FLORIDA 27618
27618
SARASOTA,
JO3

Google

27618 STEINMETZ, SARASOTA, FLORIDA 27618
SARASOTA,
27618
STEINMETZ,
FLORIDA