Human Generated Data

Title

Indian Chiefs Who Counciled with Gen. Miles and Settled the Indian War
Date

1880s
People

Artist: Grabill, American 19th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2184

Human Generated Data

Title

Indian Chiefs Who Counciled with Gen. Miles and Settled the Indian War

People

Artist: Grabill, American 19th century

Date

1880s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.9
Human 98.9
Person 98.9
Person 98.7
Person 98.6
Person 97.8
Funeral 97.7
Person 96.4
Person 95.2
Person 95
Person 90.7
People 84.8
Face 84.3
Clothing 78.2
Apparel 78.2
Female 66.7
Photography 56.9
Photo 56.9
Attorney 55.4
Standing 55.4

Imagga
created on 2021-12-14

brass 42.4
teacher 39.1
wind instrument 37.1
cornet 30.2
man 29.5
people 29.5
person 27.2
educator 25.8
professional 24.9
male 24.8
musical instrument 24.6
adult 24.6
silhouette 19
group 17.7
businessman 17.6
men 17.2
business 16.4
women 15.8
couple 15.7
room 14.8
two 14.4
black 13.8
dress 12.6
love 12.6
suit 11.7
office 11.2
happiness 11
team 10.7
family 10.7
education 10.4
hand 9.9
standing 9.6
corporate 9.4
work 9.4
happy 9.4
youth 9.4
communication 9.2
sunset 9
fun 9
interior 8.8
sax 8.8
boy 8.7
lifestyle 8.7
bride 8.6
meeting 8.5
friends 8.4
summer 8.4
world 8.2
cheerful 8.1
looking 8
life 8
indoors 7.9
stage 7.7
drawing 7.7
sitting 7.7
sport 7.7
trombone 7.5
manager 7.4
holding 7.4
style 7.4
girls 7.3
success 7.2
smiling 7.2
home 7.2
religion 7.2
holiday 7.2
player 7.1
idea 7.1
night 7.1
together 7

Google
created on 2021-12-14

Vintage clothing 73.2
Suit 72.9
Font 70.1
Event 69.9
Formal wear 68.7
Crew 65.6
Stock photography 64.2
History 63.9
Art 60.3
Room 54.9
Uniform 54.3
Pole 53.9
Team 51.3
Visual arts 50.9
Photographic paper 50.5

Microsoft
created on 2021-12-14

text 99.6
person 98.7
standing 95.7
posing 94.1
clothing 93.4
people 86.6
woman 86
group 85.7
man 79.3
smile 74.5
old 71

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-56
Gender Male, 77.6%
Calm 91.4%
Angry 1.9%
Confused 1.6%
Happy 1.5%
Sad 1.4%
Disgusted 1%
Surprised 0.7%
Fear 0.6%

AWS Rekognition

Age 51-69
Gender Female, 95.3%
Happy 76.6%
Calm 22.2%
Disgusted 0.4%
Surprised 0.2%
Confused 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 49-67
Gender Male, 92%
Calm 67.5%
Sad 25.7%
Angry 2.3%
Happy 1.9%
Disgusted 1%
Confused 0.7%
Fear 0.6%
Surprised 0.3%

AWS Rekognition

Age 27-43
Gender Female, 87.6%
Happy 73.9%
Calm 25.4%
Sad 0.3%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 27-43
Gender Male, 84.4%
Calm 89.5%
Angry 5.4%
Sad 4.1%
Happy 0.3%
Confused 0.3%
Fear 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 38-56
Gender Male, 80.2%
Calm 59.3%
Sad 26.5%
Fear 6.1%
Confused 3.5%
Happy 2.3%
Surprised 0.9%
Angry 0.9%
Disgusted 0.4%

AWS Rekognition

Age 50-68
Gender Male, 98.9%
Calm 82.8%
Fear 6.2%
Sad 3.9%
Happy 3.6%
Surprised 1.8%
Confused 0.9%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 49-67
Gender Male, 95.7%
Calm 67.4%
Sad 31%
Angry 0.9%
Happy 0.3%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Male, 98.3%
Calm 51.4%
Sad 22.9%
Happy 18.6%
Fear 3.3%
Angry 1.6%
Confused 0.8%
Disgusted 0.7%
Surprised 0.7%

AWS Rekognition

Age 27-43
Gender Female, 59.7%
Calm 65.2%
Happy 28.2%
Angry 3.6%
Disgusted 1.4%
Sad 1.3%
Fear 0.1%
Surprised 0.1%
Confused 0%

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

Iron Tail et al. posing for a photo 98.4%
Iron Tail et al. posing for a picture 98.3%
Iron Tail et al. posing for the camera 98.2%

Text analysis

Amazon

THE
AND
FOR
ONE
STATE
OUR
VIEW
PORTRAIT
S.
DETECTION
D.
Dog
WILL
the
OF
REWARD
by
ALL
UNDER
with
GRABILL
GIVE
OUR COMPANY IS UNDER STATE LAWS.
High
IS
COPYING
10
VIEWS
ANY ONE COPYING OUR PICTURES.
ANY
Photo
COMPANY
Little
White
A
LAWS.
copyright
No
THE GRABILL PORTRAIT AND VIEW CO., DEADWOOD, S. D.
Thunder
white
WILL GIVE A HANUSOME REWARD FOR DETECTION OF
INDIAN
Indian
and
PICTURES.
5 Liver
DEADWOOD,
Deadwood.S D.
CO.,
VIEWS ALL COPYRIGHTED.
5 Liver Bear.
Pipe.
No BOOK INDIAN CHIEFS
Who
Bear.
Photo and copyright by Grabili. '91,
Deadwood.S
HAWK
white horse.
E Little Thunder / Doll Dog High HAWK
HANUSOME
CHIEFS
Lame
Milos
10 Esgie Pipe.
Stancing
Who escuelloo with Gon Milos and Butteled the
backrunning
BOOK
Ball.
Die
COPYRIGHTED.
4 White Tail.
I Stancing Ball.
horse.
Tail.
3 Has the Die
Gon
9 Lame
Grabili.
I
2 Bear wholeeks backrunning
Has
'91,
9
wholeeks
E
Butteled
/ Doll
Esgie
3
4
2 Bear
War
escuelloo

Google

Ne BEO INDIAH CHIEES Sie 4 White Tall 5L i a nder Boll Dog Hrh EA nd eopyright by Grabili, '91, THE GRABILL PORTRAIT AND VIE w co., DEAD WOOD, S. D. OUR COMPANY IS INCORPORATED UNDER STATE LAWS. VIEWS ALL COPYRIGHTED. WILL GIVE A HANUSOME REWARD FOR DETECTION OF ANY ONE COPYING OUR PICTURES.
Ne
BEO
INDIAH
CHIEES
Sie
4
White
Tall
5L
i
a
nder
Boll
Dog
Hrh
EA
nd
eopyright
by
Grabili,
'91,
THE
GRABILL
PORTRAIT
AND
VIE
w
co.,
DEAD
WOOD,
S.
D.
OUR
COMPANY
IS
INCORPORATED
UNDER
STATE
LAWS.
VIEWS
ALL
COPYRIGHTED.
WILL
GIVE
A
HANUSOME
REWARD
FOR
DETECTION
OF
ANY
ONE
COPYING
PICTURES.