Human Generated Data

Title

Untitled (Brandon High School Class of 1958)

Date

1958, printed later

People

Artist: Claseman Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.97

Human Generated Data

Title

Untitled (Brandon High School Class of 1958)

People

Artist: Claseman Studio, American 20th century

Date

1958, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.7
Human 98.7
Person 98.2
Person 98.2
Person 98.1
Collage 97.5
Advertisement 97.5
Poster 97.5
Person 97.4
Person 97.3
Person 96.9
Person 96.7
Person 96.6
Person 95.5
Person 95.4
Person 95.2
Person 94.6
Person 93.7
Person 93.5
Face 92.7
Person 92.5
Person 92.1
Head 91.8
Person 84.5
Person 79
Person 74.7
Text 74.6
Person 73.5
Photography 61.5
Photo 61.5
Portrait 61.2

Imagga
created on 2021-12-14

icon 56.3
set 53.7
icons 49.4
sign 42.9
symbol 41.1
web 39.9
button 36.1
design 28.8
computer 27.3
snap 27.2
black 27.2
fastener 25.8
buttons 21.7
website 20.8
business 20.7
device 19.5
restraint 19.5
collection 19
graphic 18.3
mail 18.2
element 16.6
house 15.9
phone 15.7
home 15.2
globe 14.8
finance 14.4
knob 14.1
sound 14.1
star 13.5
communication 13.5
art 13.2
shopping 13.1
lock 12.9
clock 12.7
series 12.5
symbols 12.4
arrow 12.3
circle 12
modern 11.9
money 11.9
printer 11.8
silhouette 11.6
site 11.3
glossy 11.2
round 11.2
painting 10.9
icon set 10.8
group 10.5
telephone 10.4
document 10.2
page 10.2
elements 10.2
network 10.2
cart 9.8
information 9.8
service 9.3
bank 9.3
color 8.9
signs 8.8
interface 8.7
label 8.6
pencil 8.5
bag 8.5
car 8.4
dollar 8.4
letter 8.3
connection 8.2
global 8.2
music 8.1
discussion 7.8
email 7.8
card 7.7
chart 7.7
print 7.6
commerce 7.5
clip 7.5
coffee 7.4
food 7.4
office 7.2
reflection 7.2
world 7.1
glass 7

Google
created on 2021-12-14

Forehead 98.5
Nose 98.4
Skin 97.5
Chin 96.8
Eyebrow 95.1
Hairstyle 95.1
Photograph 94.2
Facial expression 93.3
Mouth 92.4
White 92.2
Product 90.7
Human 89.1
Jaw 88.3
Eyelash 87.8
Happy 85.6
Font 84.8
Material property 80.3
People 78.3
Team 78.1
Poster 77

Microsoft
created on 2021-12-14

text 99.7
human face 98.3
cartoon 87.7
person 83.2
drawing 80
bunch 77.1
different 66.6
sketch 65.6
group 58.1
various 48.7
several 18.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 99.3%
Happy 89.2%
Surprised 3.3%
Angry 1.9%
Fear 1.5%
Calm 1.3%
Disgusted 1.3%
Confused 1%
Sad 0.4%

AWS Rekognition

Age 14-26
Gender Male, 97.3%
Happy 98.5%
Confused 0.5%
Surprised 0.3%
Calm 0.3%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 13-23
Gender Male, 98.6%
Calm 92.6%
Confused 4.5%
Surprised 1%
Angry 0.7%
Happy 0.6%
Sad 0.4%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 20-32
Gender Female, 94.3%
Happy 94.8%
Surprised 1.3%
Confused 1.3%
Fear 0.9%
Calm 0.6%
Disgusted 0.6%
Angry 0.4%
Sad 0.1%

AWS Rekognition

Age 16-28
Gender Male, 93.8%
Calm 86.7%
Happy 7.7%
Angry 1.8%
Surprised 1.4%
Sad 0.8%
Fear 0.7%
Disgusted 0.6%
Confused 0.3%

AWS Rekognition

Age 13-23
Gender Male, 99.1%
Calm 98.1%
Angry 0.7%
Sad 0.5%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 16-28
Gender Female, 97.6%
Happy 99.8%
Surprised 0.1%
Calm 0.1%
Disgusted 0%
Confused 0%
Angry 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 20-32
Gender Female, 94%
Calm 78.2%
Happy 15%
Surprised 1.7%
Angry 1.6%
Disgusted 1%
Fear 0.9%
Sad 0.8%
Confused 0.7%

AWS Rekognition

Age 5-15
Gender Female, 96.5%
Happy 88.3%
Calm 9.4%
Disgusted 0.7%
Surprised 0.6%
Fear 0.3%
Confused 0.3%
Angry 0.2%
Sad 0.2%

AWS Rekognition

Age 22-34
Gender Female, 98%
Happy 87.5%
Disgusted 3.2%
Surprised 2.5%
Confused 2.4%
Angry 1.4%
Fear 1.3%
Calm 1.2%
Sad 0.6%

AWS Rekognition

Age 18-30
Gender Female, 98.2%
Happy 98%
Surprised 0.5%
Fear 0.3%
Disgusted 0.3%
Angry 0.3%
Confused 0.3%
Calm 0.2%
Sad 0.2%

AWS Rekognition

Age 25-39
Gender Female, 95.2%
Happy 99.3%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%
Calm 0%

AWS Rekognition

Age 15-27
Gender Male, 97.8%
Calm 99.3%
Angry 0.3%
Sad 0.2%
Happy 0.1%
Disgusted 0%
Surprised 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 17-29
Gender Male, 98.4%
Calm 92.1%
Happy 4.5%
Sad 0.8%
Disgusted 0.7%
Confused 0.6%
Surprised 0.5%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 13-25
Gender Female, 94.3%
Happy 96.9%
Surprised 1.7%
Confused 0.4%
Calm 0.3%
Fear 0.3%
Disgusted 0.2%
Angry 0.2%
Sad 0.1%

AWS Rekognition

Age 12-22
Gender Male, 98.4%
Calm 89.6%
Happy 5.8%
Confused 1.8%
Angry 1%
Sad 0.6%
Surprised 0.5%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 22-34
Gender Female, 98%
Happy 98.7%
Disgusted 0.4%
Surprised 0.3%
Confused 0.2%
Calm 0.1%
Angry 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Female, 79.4%
Calm 52.9%
Confused 30.9%
Surprised 6.2%
Sad 3%
Happy 2.5%
Disgusted 1.7%
Angry 1.4%
Fear 1.4%

AWS Rekognition

Age 21-33
Gender Male, 98.7%
Happy 99.6%
Surprised 0.1%
Calm 0.1%
Fear 0%
Confused 0%
Angry 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 22-34
Gender Female, 99.7%
Happy 99.8%
Surprised 0.1%
Confused 0%
Calm 0%
Angry 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-30
Gender Male, 99.1%
Calm 99.6%
Angry 0.2%
Sad 0.1%
Happy 0.1%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-32
Gender Male, 98.8%
Calm 61.1%
Angry 34%
Sad 2.6%
Fear 0.8%
Confused 0.7%
Disgusted 0.5%
Surprised 0.3%
Happy 0%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of men posing for a photo 42.4%
Jackie Cooper et al. posing for a photo 42.3%
Jackie Cooper et al. posing for the camera 42.2%

Text analysis

Amazon

CLASS
SCHOOL
Lois
BRANDON
CLASS of 1958
1958
ROGER
SCHULTE
of
DEAN
Juor
GAYLE
KAREL
JANET
ROBERT
ALAN
MILLER
GREEN
GAYLE EHLERS
ALAN TUNTLAND
ROGER PARHAM
ANDERSON
TUNTLAND
BURKMAN
EHLERS
STUDENT
CARLENE
PARHAM
VICE
BRANDON HiGH SCHOOL
TREASURER
PRESIDENT
Juor FRANKEN
JANET JOHNSON
SECRETARY
MARTINA GREEN
PETERSON
DELORES
DEAN Bisson
MALON ANDERSON
JOHNSON
FRANKEN
Rist
MARTINA
DELORES HALVEASON
MARTiN GREEN
MALON
HiGH
HALVEASON
Bisson
JOAN
JOAN PETERSON
Lois NELSON
JEAN PETERSON
MARTiN
STUDENT COUNCIL
Том SCHULTE
ELMER
JEAN
BONNIE Rist
NELSON
HAADING
ROBERT HorT
KAREL WiNTERTON
COUNCIL
Burnie BURKMAN
David HAADING
Том
OLSOM
David
Davio OLSOM
BONNIE
Davio
HorT
WiNTERTON
Burnie

Google

MAATiNa
JANET
Juor
BissON
Lois
NELSON
MILLER
KAREL
Davio
PRESIDENT
VICE
SECRETARY
BRANDON
CLASS
PRAMAM
OLsOM
PETERSON
MARTIN GREEN MAATiNa GREEN JANET JOHNSON ROBERT Hor T BONNie RisT Juor FRANK EN DEAN BissON Lois NELSON ELMER MILLER Tom SCHULTE KAREL WINTEATON Davio HAADING ALAN TUNTL AND BURNIE BURKMAN TREASURER STUBENT COUNCIL AePRESeTAPive PRESIDENT VICE PAESIDENT SECRETARY BRANDON HIGH SCHOOL CLASS d 1958 MALON ANDERSON DELORES HALVERSON RoGER PRAMAM Davio OLsOM GAVLE EHLEAS JOAN PETERSON JEAN ParEnsON CAALENE ANDERSON
JOHNSON
WINTEATON
ALAN
BURKMAN
TREASURER
SCHOOL
d
1958
RoGER
GAVLE
ParEnsON
CAALENE
ROBERT
BONNie
RisT
HAADING
AePRESeTAPive
PAESIDENT
HIGH
ANDERSON
HALVERSON
JOAN
T
FRANK
EN
DEAN
ELMER
Tom
TUNTL
MALON
EHLEAS
MARTIN
GREEN
Hor
SCHULTE
AND
BURNIE
STUBENT
COUNCIL
DELORES
JEAN