Human Generated Data

Title

Untitled (extended family at Christmas tree, Manchester, New Hampshire)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.79

Human Generated Data

Title

Untitled (extended family at Christmas tree, Manchester, New Hampshire)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.79

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.4
Human 99.4
Person 98.7
Person 97.9
Person 96.7
Person 94.2
Advertisement 90.4
Poster 90.4
Person 90.2
Clothing 87.8
Apparel 87.8
Monitor 86.3
Display 86.3
Electronics 86.3
Screen 86.3
Person 84.6
Person 82.8
Person 79.6
Room 77.9
Indoors 77.9
Crowd 77.8
People 77.6
Person 69.1
Person 68.2
Audience 62
Leisure Activities 60.3
Musician 57.5
Musical Instrument 57.5

Clarifai
created on 2023-10-15

people 100
group 99.9
many 99.3
child 98.2
monochrome 98.2
woman 97.2
adult 97.1
group together 95.9
television 95.2
movie 95
documentary 93.9
family 93.9
man 93.3
nostalgia 92.8
war 92.2
several 91.7
portrait 91.7
snapshot 90
retro 89.7
music 87.8

Imagga
created on 2021-12-14

web site 80
television 53.6
screen 31.3
monitor 31
display 26.8
telecommunication system 23.9
background 22.8
business 19.4
office 19.3
black 18
money 17.9
technology 17.8
computer 17.2
global 16.4
broadcasting 15.8
cash 15.5
financial 15.1
vintage 14.9
equipment 14.6
stamp 14.5
art 14.4
mail 14.4
close 14.3
dollar 13.9
postmark 13.8
postage 13.8
letter 13.7
postal 13.7
envelope 13.6
finance 13.5
closeup 12.8
one 12.7
currency 12.6
design 12.4
telecommunication 12
modern 11.9
icon 11.9
object 11.7
man 11.4
old 11.1
circa 10.8
printed 10.8
symbol 10.8
wealth 10.8
hundred 10.6
communications 10.5
laptop 10.4
electronic 10.3
savings 10.2
paper 10.2
banking 10.1
communication 10.1
shows 9.8
paintings 9.8
us 9.6
painted 9.5
post 9.5
unique 9.5
work 9.4
rich 9.3
electronic equipment 9.1
electronic device 9.1
paint 9
bank 9
post mail 8.9
zigzag 8.9
masterpiece 8.9
fame 8.9
known 8.9
renaissance 8.8
working 8.8
painter 8.8
banknotes 8.8
delivery 8.7
museum 8.7
letters 8.7
dollars 8.7
cutting 8.7
flat 8.7
navigation 8.7
fine 8.6
media 8.6
culture 8.5
web 8.5
people 8.4
person 8.3
digital 8.1
desktop 7.7
frame 7.7
bill 7.6
tech 7.6
pattern 7.5
network 7.5
map 7.5
medium 7.3
device 7.2
portrait 7.1
face 7.1
male 7.1
information 7.1

Google
created on 2021-12-14

Photograph 94.2
Font 82.4
Picture frame 80.3
Suit 75.2
Snapshot 74.3
Event 71.6
Rectangle 66.7
Art 66.7
Stock photography 64.5
Room 63.8
Visual arts 62.5
Display device 60.2
Photo caption 59.6
Team 57.2
Family reunion 50.5
History 50.3

Microsoft
created on 2021-12-14

text 99.9
person 98.4
posing 97.4
clothing 97.4
monitor 92.5
man 84.1
old 81.1
standing 77.1
group 71.8
black 70.3
woman 67.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 98.9%
Calm 91.4%
Happy 6%
Sad 1.2%
Angry 0.6%
Confused 0.2%
Fear 0.2%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 45-63
Gender Male, 93.5%
Happy 81.3%
Calm 15.3%
Surprised 1.1%
Disgusted 0.6%
Confused 0.5%
Sad 0.5%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 36-52
Gender Female, 82.4%
Happy 79.6%
Calm 17.1%
Surprised 0.8%
Angry 0.6%
Sad 0.6%
Disgusted 0.5%
Fear 0.5%
Confused 0.3%

AWS Rekognition

Age 38-56
Gender Female, 78.5%
Calm 94.6%
Happy 1.4%
Sad 1.1%
Confused 1%
Surprised 0.6%
Angry 0.6%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 13-25
Gender Male, 85.9%
Calm 96.7%
Happy 1.4%
Surprised 1.1%
Angry 0.3%
Fear 0.2%
Sad 0.2%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 5-15
Gender Male, 90.4%
Happy 94.7%
Calm 3.7%
Surprised 0.9%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 27-43
Gender Male, 98.8%
Calm 67.8%
Sad 12.1%
Happy 5.8%
Fear 4.4%
Confused 3.7%
Surprised 3.2%
Angry 1.8%
Disgusted 1.2%

AWS Rekognition

Age 24-38
Gender Male, 98.4%
Happy 95.6%
Calm 2.1%
Surprised 0.7%
Angry 0.5%
Confused 0.4%
Fear 0.3%
Disgusted 0.3%
Sad 0.1%

AWS Rekognition

Age 21-33
Gender Female, 96.9%
Calm 86.3%
Disgusted 5.5%
Angry 4.2%
Surprised 1.5%
Sad 1.2%
Happy 0.7%
Fear 0.4%
Confused 0.2%

AWS Rekognition

Age 23-35
Gender Female, 99.1%
Calm 87.4%
Angry 4.9%
Surprised 3.1%
Sad 1.6%
Confused 1.2%
Happy 0.7%
Fear 0.6%
Disgusted 0.4%

AWS Rekognition

Age 5-15
Gender Female, 80.2%
Happy 90.9%
Calm 2.2%
Fear 2.1%
Angry 1.1%
Surprised 1.1%
Sad 0.9%
Confused 0.9%
Disgusted 0.8%

AWS Rekognition

Age 32-48
Gender Female, 98.4%
Happy 98.6%
Calm 0.4%
Surprised 0.3%
Angry 0.2%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 24-38
Gender Male, 85.9%
Fear 51.6%
Angry 34.4%
Calm 6.5%
Surprised 4%
Sad 1.3%
Confused 1.1%
Happy 0.6%
Disgusted 0.5%

AWS Rekognition

Age 23-37
Gender Female, 99.7%
Happy 43.5%
Calm 31.4%
Disgusted 6.2%
Confused 5.9%
Surprised 5.7%
Angry 3.1%
Fear 2.4%
Sad 1.9%

AWS Rekognition

Age 5-15
Gender Female, 56.6%
Calm 60.5%
Surprised 18.1%
Fear 9.1%
Sad 4.5%
Angry 4.4%
Confused 2.7%
Happy 0.5%
Disgusted 0.1%

AWS Rekognition

Age 32-48
Gender Female, 96.4%
Calm 70.1%
Happy 21.2%
Surprised 1.9%
Disgusted 1.8%
Angry 1.4%
Confused 1.3%
Sad 1.1%
Fear 1.1%

AWS Rekognition

Age 8-18
Gender Male, 70.5%
Calm 82.5%
Happy 6.3%
Angry 3.9%
Sad 3.6%
Confused 2.1%
Disgusted 0.8%
Fear 0.6%
Surprised 0.4%

AWS Rekognition

Age 5-15
Gender Female, 94.4%
Calm 71.9%
Happy 5.9%
Confused 5.6%
Disgusted 5.3%
Angry 4.2%
Surprised 2.9%
Sad 2.3%
Fear 2%

AWS Rekognition

Age 47-65
Gender Female, 75.1%
Angry 55.7%
Calm 18.2%
Fear 7%
Disgusted 6.4%
Surprised 5.5%
Happy 3%
Sad 2.5%
Confused 1.6%

AWS Rekognition

Age 51-69
Gender Female, 64.5%
Calm 97.3%
Happy 1%
Disgusted 0.6%
Angry 0.4%
Sad 0.2%
Surprised 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 22-34
Gender Female, 96.4%
Happy 97.1%
Surprised 1.7%
Calm 0.7%
Confused 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 32-48
Gender Female, 91.7%
Calm 24.9%
Happy 23.5%
Surprised 16.2%
Fear 14.6%
Sad 13.7%
Angry 5.3%
Confused 1.2%
Disgusted 0.6%

AWS Rekognition

Age 24-38
Gender Male, 83.1%
Calm 64.2%
Happy 21.7%
Fear 4.7%
Sad 4.3%
Surprised 3.3%
Angry 0.9%
Confused 0.6%
Disgusted 0.3%

AWS Rekognition

Age 32-48
Gender Male, 92%
Calm 63.6%
Happy 28.7%
Surprised 4.4%
Sad 0.8%
Confused 0.8%
Fear 0.8%
Angry 0.6%
Disgusted 0.3%

AWS Rekognition

Age 3-11
Gender Female, 67.3%
Calm 92%
Angry 6.1%
Sad 0.8%
Surprised 0.5%
Disgusted 0.2%
Happy 0.1%
Fear 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Poster 90.4%
Monitor 86.3%

Categories

Imagga

paintings art 98.1%
interior objects 1%

Text analysis

Amazon

82%
n.d.
George
New
Durette
180
George Durette Studio
Manchester, New Hampshire
Studio
Hampshire
Manchester,
08

Google

George
Durette
Manches
ter,
n.d.
180
827 George Durette Studio Manches ter, New Hampshire n.d. 180
827
Studio
New
Hampshire