Human Generated Data

Title

Untitled (Christmas card from Sunday School class, children and teachers with nativity scene)
Date

c. 1950
People

Artist: Robert Burian, American active 1940s-1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19053

Human Generated Data

Title

Untitled (Christmas card from Sunday School class, children and teachers with nativity scene)

People

Artist: Robert Burian, American active 1940s-1950s

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19053

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Interior Design 100
Indoors 100
Poster 99.8
Advertisement 99.8
Person 99.2
Human 99.2
Person 99.1
Person 98.1
Person 97.9
Person 97.3
Person 96.7
Person 95.7
Person 94.4
Person 93.1
Monitor 91.6
Display 91.6
Screen 91.6
Electronics 91.6
Person 91.2
Chair 89.3
Furniture 89.3
Person 88.4
Room 87
Clothing 85.7
Apparel 85.7
Person 85.6
Face 85.3
Person 85.3
Person 85.1
Text 79.4
Crowd 78.3
Female 75.7
Kid 74.9
Child 74.9
Suit 74.4
Coat 74.4
Overcoat 74.4
Theater 71.5
People 68.5
Stage 67
Portrait 66.9
Photography 66.9
Photo 66.9
Girl 65.6
Play 65.5
LCD Screen 62.9
Audience 62.6
Leisure Activities 61.6
Baby 60.2
Cinema 59.7
Living Room 58.9
Collage 58.7
TV 58.4
Television 58.4
Man 58
Silhouette 57.1
Shorts 57
Woman 56.5

Clarifai
created on 2023-10-22

people 99.7
child 97.2
group 96.7
group together 96.3
man 94.9
woman 94.3
many 93.3
adult 93
monochrome 89.9
recreation 88.5
wear 88.4
boy 87.4
spectator 83.4
several 83.1
family 82
audience 80.9
illustration 79.6
adolescent 79.6
education 71.5
crowd 70.7

Imagga
created on 2022-03-05

blackboard 22.6
business 22.5
money 18.7
finance 18.6
currency 17.9
grunge 17.9
bill 15.2
cash 14.6
man 14.3
black 13.8
bank 13.4
financial 13.4
old 13.2
hand 13
note 12.9
design 12.4
graphic 12.4
board 12.2
economy 12
paper 12
drawing 11.4
education 11.3
structure 11.2
vintage 10.7
people 10.6
businessman 10.6
sign 10.5
profit 10.5
texture 10.4
art 9.8
container 9.8
success 9.6
building 9.2
silhouette 9.1
dirty 9
history 8.9
pattern 8.9
chalk 8.8
symbol 8.7
banknote 8.7
text 8.7
pay 8.6
world 8.4
banking 8.3
retro 8.2
envelope 8.2
decoration 8.1
wealth 8.1
conceptual 7.9
antique 7.8
bills 7.8
shop 7.7
dollars 7.7
grungy 7.6
support 7.5
savings 7.5
wall 7.4
investment 7.3
message 7.3
aged 7.2
computer 7.2
market 7.1

Google
created on 2022-03-05

White 92.2
Black 89.8
Rectangle 89
Black-and-white 84.5
Style 83.9
Font 83.5
Monochrome 74.5
Monochrome photography 73.6
Chair 72.8
Event 71.3
Room 70.8
Window 68.8
Art 68.6
Design 68.3
Handwriting 66.4
Pattern 66
Visual arts 65.1
Stock photography 62.6
Vintage clothing 56.2
Suit 56

Microsoft
created on 2022-03-05

cartoon 98.4
text 98.2
handwriting 94.2
person 86.2
drawing 83.2
clothing 76.3
poster 75.3
black and white 73.2
posing 45.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 99.5%
Happy 47.1%
Calm 40%
Sad 4.2%
Angry 3.1%
Disgusted 2.1%
Surprised 1.7%
Fear 1%
Confused 0.8%

AWS Rekognition

Age 51-59
Gender Male, 61.8%
Sad 91.6%
Happy 6.3%
Calm 1%
Confused 0.4%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 30-40
Gender Male, 91.8%
Calm 92.5%
Happy 3.5%
Surprised 1%
Disgusted 1%
Angry 0.8%
Sad 0.6%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 34-42
Gender Male, 96.2%
Happy 93.4%
Calm 4.7%
Sad 1.3%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 98.1%
Calm 76%
Happy 21.8%
Sad 1.5%
Fear 0.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Calm 84.1%
Sad 13.6%
Happy 0.6%
Confused 0.5%
Angry 0.4%
Surprised 0.3%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 12-20
Gender Female, 80.9%
Calm 33.3%
Sad 33.1%
Fear 9.2%
Confused 7.5%
Happy 7%
Angry 4%
Surprised 3.1%
Disgusted 2.9%

AWS Rekognition

Age 25-35
Gender Female, 97.1%
Happy 74.5%
Calm 22.5%
Sad 1.6%
Confused 0.4%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 28-38
Gender Male, 98.7%
Calm 99.4%
Happy 0.2%
Sad 0.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster
Person
Poster 99.8%
Person 99.2%
Person 99.1%
Person 98.1%
Person 97.9%
Person 97.3%
Person 96.7%
Person 95.7%
Person 94.4%
Person 93.1%
Person 91.2%
Person 88.4%
Person 85.6%
Person 85.3%
Person 85.1%

Text analysis

Amazon

from
82
and
Christmas
to
Merry
Very
Christmas to You!
AV Very Merry
willard
from mrs Bunan and wis willard
You!
mrs
Bunan
AV
wis

Google

AVay Mary hom mas Bunau aud e. willoud
AVay
Mary
hom
mas
Bunau
aud
e.
willoud