Human Generated Data

Title

Untitled (man dressed as Santa Claus with children on sleigh)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15630

Human Generated Data

Title

Untitled (man dressed as Santa Claus with children on sleigh)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15630

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 98.9
Human 98.9
Furniture 98.8
Person 98.5
Person 97.3
Clothing 91.1
Apparel 91.1
Chair 88.6
Painting 78.7
Art 78.7
Person 77.4
Wood 69.3
Vehicle 64.4
Transportation 64.4
Hat 61
Spoke 60.4
Machine 60.4
Sitting 57
Senior Citizen 56.4
People 55.9

Clarifai
created on 2023-10-29

people 99.3
woman 98.4
man 97.9
street 94.9
girl 94.8
couple 94.4
art 93.8
group 93
adult 92.9
winter 92.5
child 92.3
travel 92.2
love 90.6
wear 90.4
two 89.6
portrait 89.4
family 87.9
costume 87.9
chair 86.4
wedding 85.6

Imagga
created on 2022-02-05

person 24.8
book jacket 21.1
people 19.5
silhouette 18.2
jacket 17.3
symbol 15.5
lights 14.8
crowd 14.4
cheering 13.7
nighttime 13.7
audience 13.6
stadium 13.6
icon 13.4
patriotic 13.4
nation 13.2
flag 13.1
wrapping 12.4
model 12.4
comic book 12.2
black 12
design 11.9
art 11.7
sport 11.5
adult 11.5
interior 11.5
bright 10.7
covering 10.6
fashion 10.5
lady 10.5
player 10.5
attractive 10.5
style 10.4
sitting 10.3
event 10.2
park 10.1
elegance 10.1
competition 10.1
vintage 9.9
chair 9.8
window 9.8
group 9.7
television 9.6
body 9.6
muscular 9.5
building 9.3
drawing 8.9
posing 8.9
versus 8.9
man 8.9
sexy 8.8
office 8.8
hair 8.7
match 8.7
athlete 8.5
business 8.5
portrait 8.4
pretty 8.4
training 8.3
glowing 8.3
paint 8.1
happy 8.1
love 7.9
vibrant 7.9
room 7.8
shorts 7.8
male 7.8
championship 7.8
gloves 7.7
luxury 7.7
skill 7.7
performance 7.7
human 7.5
one 7.5
creation 7.4
playing 7.3
home 7.2

Google
created on 2022-02-05

Window 91.6
Tree 86.2
Plant 82.3
Happy 79.4
Adaptation 79.3
Tints and shades 77.4
Art 76.7
Rectangle 76.4
Magenta 74
Electronic device 73.6
Wood 73.4
Chair 70
Vintage clothing 69.3
Event 68.7
Visual arts 68
Font 67.1
Photo caption 65.5
Room 64.2
Square 63.9
Lap 63

Microsoft
created on 2022-02-05

text 98.5
book 94.9
person 59.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 59-67
Gender Male, 99.9%
Confused 41.9%
Calm 31.1%
Angry 8.1%
Disgusted 7%
Sad 4.3%
Happy 3.9%
Fear 2.6%
Surprised 1.1%

AWS Rekognition

Age 6-12
Gender Female, 99.3%
Angry 33.1%
Calm 32.1%
Sad 19.3%
Happy 5.2%
Disgusted 4.3%
Confused 3.6%
Fear 1.4%
Surprised 1%

AWS Rekognition

Age 31-41
Gender Female, 86.4%
Calm 68.9%
Angry 24.3%
Sad 5.4%
Happy 0.5%
Surprised 0.3%
Disgusted 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Female, 99.6%
Calm 78.8%
Sad 13.1%
Confused 2.4%
Fear 2%
Angry 1.1%
Disgusted 1%
Happy 0.9%
Surprised 0.8%

Microsoft Cognitive Services

Age 69
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 98.9%
Person 98.5%
Person 97.3%
Person 77.4%
Painting 78.7%

Captions

Microsoft
created on 2022-02-05

a group of people sitting on a cart 51.7%
a person sitting on a cart 42.5%

Text analysis

Amazon

8
A°S
NAGON
E
I r w

Google

KODVK KODVK YT37 A'2
KODVK
YT37
A'2